[ 650.894178] env[62620]: INFO neutron.common.config [-] Logging enabled! [ 650.894478] env[62620]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.0.0.0b3.dev76 [ 650.894733] env[62620]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62620) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 650.895068] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 650.895175] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 650.895996] env[62620]: WARNING oslo_policy.policy [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 650.896236] env[62620]: WARNING oslo_policy.policy [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 650.897714] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] VMware NSXv3 Agent initialized successfully. [ 650.898091] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] Acquiring lock "singleton_lock" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.898242] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] Acquired lock "singleton_lock" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.898454] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] Releasing lock "singleton_lock" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.898741] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] Full set of CONF: {{(pid=62620) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} [ 650.898866] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ******************************************************************************** {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 650.898981] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] Configuration options gathered from: {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 650.899331] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 650.899564] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 650.899680] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ================================================================================ {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 650.899830] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] agent_down_time = 75 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.899990] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] allow_automatic_dhcp_failover = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.900154] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] allow_bulk = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.900311] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] api_extensions_path = {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.900462] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] api_paste_config = api-paste.ini {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.900615] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] auth_strategy = keystone {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.900731] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] backdoor_port = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.900844] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] backdoor_socket = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.900996] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] backlog = 4096 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.901160] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] base_mac = fa:16:3e:00:00:00 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.901328] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] bind_host = 0.0.0.0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.901483] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] bind_port = 9696 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.901630] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] client_socket_timeout = 900 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.901786] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] config_dir = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.901932] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.902103] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] config_source = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.902262] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] control_exchange = neutron {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.902417] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] core_plugin = ml2 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.902624] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] debug = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.902704] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] default_availability_zones = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.902968] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.903140] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] dhcp_agent_notification = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.903292] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] dhcp_agents_per_network = 1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.903440] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] dhcp_lease_duration = 86400 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.903595] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] dhcp_load_type = networks {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.903745] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] dns_domain = openstacklocal {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.903895] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.904051] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] enable_default_route_bfd = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.904218] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] enable_default_route_ecmp = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.904369] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] enable_dvr = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.904512] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] enable_new_agents = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.904657] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.904803] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] enable_signals = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.904945] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] enable_traditional_dhcp = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.905097] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] external_dns_driver = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.905244] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] filter_validation = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.905397] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] global_physnet_mtu = 8950 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.905544] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] graceful_shutdown_timeout = 60 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.905731] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] host = cpu-1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.905885] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] host_dvr_for_dhcp = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.906045] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] http_retries = 3 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.906201] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] instance_format = [instance: %(uuid)s] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.906353] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.906504] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ipam_driver = internal {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.906651] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ipv6_pd_enabled = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.906798] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] l3_ha = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.906953] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.907117] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] l3_ha_network_physical_name = {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.907271] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] l3_ha_network_type = {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.907422] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] log_color = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.907573] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] log_config_append = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.907725] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.907873] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] log_dir = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.908028] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] log_file = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.908146] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] log_options = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.908296] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] log_rotate_interval = 1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.908452] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] log_rotate_interval_type = days {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.908603] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] log_rotation_type = none {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.908718] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.908830] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.908983] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.909145] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.909260] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.909410] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] max_dns_nameservers = 5 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.909555] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] max_header_line = 16384 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.909709] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] max_l3_agents_per_router = 3 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.909874] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] max_logfile_count = 30 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.910034] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] max_logfile_size_mb = 200 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.910183] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] max_subnet_host_routes = 20 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.910339] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] my_ip = 10.180.1.21 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.910490] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] my_ipv6 = ::1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.910635] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] network_auto_schedule = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.910778] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] network_link_prefix = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.910929] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.911093] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] notify_nova_on_port_data_changes = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.911244] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] notify_nova_on_port_status_changes = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.911396] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] pagination_max_limit = -1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.911540] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] publish_errors = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.911686] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] rate_limit_burst = 0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.911864] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] rate_limit_except_level = CRITICAL {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.912038] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] rate_limit_interval = 0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.912197] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] retry_until_window = 30 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.912332] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] router_distributed = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.912477] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] rpc_resources_processing_step = 20 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.912632] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] rpc_response_max_timeout = 600 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.912770] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] rpc_response_timeout = 60 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.912913] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] send_events_interval = 2 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.913076] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] service_plugins = ['router'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.913233] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] setproctitle = on {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.913375] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] shell_completion = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.913524] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] state_path = /opt/stack/data/neutron {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.913673] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] syslog_log_facility = LOG_USER {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.913820] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] tcp_keepidle = 600 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.913970] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] transport_url = **** {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.914143] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] use_journal = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.914340] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] use_json = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.914495] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] use_ssl = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.914642] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] use_stderr = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.914812] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] use_syslog = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.914940] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] vlan_transparent = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.915096] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] watch_log_file = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.915245] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] wsgi_default_pool_size = 100 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.915389] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] wsgi_keep_alive = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.915541] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.915686] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] wsgi_server_debug = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 650.915846] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_concurrency.disable_process_locking = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.916011] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.916175] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.916324] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.916479] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.916632] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.916780] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.916942] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.connection_string = messaging:// {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.917109] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.enabled = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.917267] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.es_doc_type = notification {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.917419] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.es_scroll_size = 10000 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.917572] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.es_scroll_time = 2m {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.917720] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.filter_error_trace = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.917872] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.hmac_keys = **** {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.918032] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.sentinel_service_name = mymaster {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.918192] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.socket_timeout = 0.1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.918343] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.trace_requests = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.918491] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler.trace_sqlalchemy = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.918652] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler_jaeger.process_tags = {} {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.918812] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler_jaeger.service_name_prefix = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.918946] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] profiler_otlp.service_name_prefix = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.919116] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.enforce_new_defaults = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.919397] env[62620]: WARNING oslo_config.cfg [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 650.919561] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.enforce_scope = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.919737] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.policy_default_rule = default {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.919973] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.920224] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.920427] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.920608] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.920756] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.920904] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.921069] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.921228] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.921392] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.921554] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] agent.extensions = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.921710] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.921899] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] service_providers.service_provider = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.922349] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.default_quota = -1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.922349] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.922349] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.quota_floatingip = 50 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.922672] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.quota_network = 100 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.922672] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.quota_port = 500 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.922882] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.922932] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.quota_router = 10 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.923130] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.quota_security_group = 10 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.923201] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.923333] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.quota_subnet = 100 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.923478] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] QUOTAS.track_quota_usage = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.923636] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.923781] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep.group = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.923922] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep.helper_command = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.924085] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.924297] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep.thread_pool_size = 8 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.924467] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep.user = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.924627] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.924771] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_dhcp_release.group = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.924927] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_dhcp_release.helper_command = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.925080] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.925232] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.925389] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_dhcp_release.user = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.925570] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.925715] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_ovs_vsctl.group = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.925863] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_ovs_vsctl.helper_command = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.926022] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.926193] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.926337] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_ovs_vsctl.user = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.926486] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_namespace.capabilities = [21] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.926638] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_namespace.group = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.926809] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_namespace.helper_command = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.926965] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.927129] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_namespace.thread_pool_size = 8 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.927273] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_namespace.user = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.927425] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_conntrack.capabilities = [12] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.927570] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_conntrack.group = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.927714] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_conntrack.helper_command = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.927867] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.928027] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.928176] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_conntrack.user = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.928381] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_link.capabilities = [12, 21] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.928553] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_link.group = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.928698] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_link.helper_command = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.928848] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.928997] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_link.thread_pool_size = 8 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.929153] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] privsep_link.user = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.929323] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.929483] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.929636] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.continue_on_failed_promotions = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.929808] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.dscp = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.929967] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.dscp_inherit = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.930136] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.force_mp_to_policy = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.930287] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.locking_coordinator_url = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.930434] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.log_agent_heartbeats = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.930583] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.logging_expire = 1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.930737] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.930888] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.931053] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.polling_interval = 240 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.931209] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.931365] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.931520] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.report_interval = 30.0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.931674] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.931848] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.932025] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.932173] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.sync_skew = 60 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.932323] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.synchronization_queue_size = 20 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.932478] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT.use_helper_for_ns_read = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.932637] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] SECURITYGROUP.enable_ipset = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.932822] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] SECURITYGROUP.enable_security_group = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.932955] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.933124] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.933345] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] experimental.ipv6_pd_enabled = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.933448] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ml2.extension_drivers = ['port_security'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.933595] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ml2.external_network_type = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.933755] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.933910] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ml2.overlay_ip_version = 4 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.934073] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ml2.path_mtu = 8950 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.934250] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ml2.physical_network_mtus = {} {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.934415] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ml2.tenant_network_types = ['vlan'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.934583] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.934721] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ml2.type_drivers = ['vlan'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.934879] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT_CLI.neutron_port_id = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.935037] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.935190] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.935349] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.935504] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.935658] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.935811] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.935967] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.936135] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.936353] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.936517] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_login_password = **** {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.936678] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_login_port = 443 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.936831] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_login_user = admin {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.937011] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.937169] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.937320] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.937469] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.937622] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.937781] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.937940] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.938093] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.938245] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.938418] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.938555] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.938708] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.938864] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.939084] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.939248] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] vsphere.vsphere_login_password = VMware1! {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.939403] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.939564] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.939736] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.auth_section = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.939908] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.auth_type = password {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.940081] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.940255] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.certfile = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.940385] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.collect_timing = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.940538] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.endpoint_type = public {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.940686] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.insecure = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.940829] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.keyfile = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.940983] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.region_name = RegionOne {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.941144] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.split_loggers = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.941289] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] nova.timeout = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.941444] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.auth_section = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.941598] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.auth_type = password {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.941751] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.941922] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.certfile = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.942086] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.collect_timing = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.942559] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.endpoint_type = public {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.942559] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.insecure = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.942559] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.keyfile = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.942652] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.region_name = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.942790] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.split_loggers = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.942940] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] placement.timeout = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.943102] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.auth_section = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.943252] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.auth_type = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.943396] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.cafile = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.943543] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.certfile = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.943691] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.collect_timing = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.943838] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.connect_retries = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.943983] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.connect_retry_delay = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.944158] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.enable_notifications = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.944311] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.endpoint_override = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.944458] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.insecure = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.944599] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.interface = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.945138] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.keyfile = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.945138] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.max_version = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.945138] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.min_version = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.945262] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.region_name = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.945328] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.retriable_status_codes = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.945455] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.service_name = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.945605] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.service_type = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.945753] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.split_loggers = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.945898] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.status_code_retries = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.946053] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.status_code_retry_delay = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.946201] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.timeout = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.946346] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.valid_interfaces = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.946493] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ironic.version = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.946648] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] cli_script.dry_run = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.946805] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.946957] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.947120] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.947269] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.947413] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.947559] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.947705] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.947853] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.948023] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.948171] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.948316] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.948473] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.948630] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.948784] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.948939] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.949101] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.949254] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.949411] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.949559] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.949723] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.949892] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.950058] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.950209] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.950391] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.950504] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.950651] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.950799] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.950949] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.951105] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.951253] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.ssl = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.951412] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.951565] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.951722] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.951903] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.952087] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.952249] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.952445] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_notifications.driver = [] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.952624] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_notifications.retry = -1 {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.952825] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.952952] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 650.953085] env[62620]: DEBUG oslo_service.service [None req-1167e159-f783-4ec3-a57b-6b2b88a82ea0 None None] ******************************************************************************** {{(pid=62620) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 650.954122] env[62620]: DEBUG neutron.agent.securitygroups_rpc [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Init firewall settings (driver=nsxv3) {{(pid=62620) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 650.955449] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=62620) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 650.955683] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] RPC agent_id: nsxm-l-01a.corp.local [ 650.957992] env[62620]: DEBUG dogpile.cache.region [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.958131] env[62620]: DEBUG dogpile.lock [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.958255] env[62620]: DEBUG dogpile.lock [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.958368] env[62620]: DEBUG dogpile.lock [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.958474] env[62620]: DEBUG dogpile.cache.region [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.958569] env[62620]: DEBUG dogpile.lock [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.958698] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.977330] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Session token - acquiring [ 650.978862] env[62620]: DEBUG networking_nsxv3.common.locking [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.979058] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.979159] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.979589] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.990756] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.265377] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 651.287270] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.287423] env[62620]: DEBUG dogpile.cache.region [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Cache value generated in 0.329 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.287549] env[62620]: DEBUG dogpile.lock [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.287680] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Activating Policy API Provider. [ 651.287877] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Looking for the default Infrastructure Rules. [ 651.355637] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Looking for the Default Layer3 Logged Drop Section. [ 651.369614] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 651.370194] env[62620]: DEBUG networking_nsxv3.common.locking [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.370395] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquiring lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.370509] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.370800] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired external semaphore "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.371163] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.887328] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.389980] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.892082] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Inventory metadata is going to be refreshed. [ 652.892264] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 653.766394] env[62620]: DEBUG networking_nsxv3.common.locking [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.766888] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.766888] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.767075] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.778240] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 653.779093] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.779984] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 653.795884] env[62620]: DEBUG networking_nsxv3.common.locking [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.796124] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.796209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.796468] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.796597] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.796745] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 653.796866] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 653.796985] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 653.815238] env[62620]: DEBUG networking_nsxv3.common.locking [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.815480] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.815564] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.815808] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.815988] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.816152] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 653.834052] env[62620]: DEBUG networking_nsxv3.common.locking [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.834288] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.834356] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.834597] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.834740] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.834883] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 653.851358] env[62620]: DEBUG networking_nsxv3.common.locking [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.851550] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquiring lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.851622] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.851988] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired external semaphore "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.852136] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Releasing lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.852277] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 653.852384] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 653.852493] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 653.868740] env[62620]: DEBUG networking_nsxv3.common.locking [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.868917] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquiring lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.869064] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.869340] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired external semaphore "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.869422] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Releasing lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.869558] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 653.869665] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 653.869787] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 653.885710] env[62620]: DEBUG networking_nsxv3.common.locking [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.885876] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.885968] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.886234] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.886375] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.886515] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 653.886622] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 653.886724] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Inventory metadata have been refreshed. [ 653.886823] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Dryrun:True. Metadata refresh completed. [ 653.886941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Releasing lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.888609] env[62620]: INFO neutron.agent.agent_extensions_manager [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Loaded agent extensions: [] [ 653.889321] env[62620]: DEBUG neutron_lib.callbacks.manager [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=62620) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 653.944681] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent RPC Daemon Started! [ 653.944847] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent loop - iteration:0 started [ 653.944907] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent out of sync with plugin! [ 658.890705] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 658.891101] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 663.892378] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 663.892725] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 667.667155] env[62620]: INFO networking_nsxv3.common.synchronization [None req-966370f6-4193-488b-8384-c43ee430d6fd demo admin] Enqueued Resource ID: e3a6db16-e282-4656-8702-ff0588e704fd with Priority: HIGHEST for action security_group_rules [ 667.667155] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3a6db16-e282-4656-8702-ff0588e704fd with Priority: HIGHEST for action security_group_rules [ 667.667440] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3a6db16-e282-4656-8702-ff0588e704fd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.667493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3a6db16-e282-4656-8702-ff0588e704fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.667605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3a6db16-e282-4656-8702-ff0588e704fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.667933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3a6db16-e282-4656-8702-ff0588e704fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.668024] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3a6db16-e282-4656-8702-ff0588e704fd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.187039] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.187343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.187343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.187525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.187640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.187751] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3a6db16-e282-4656-8702-ff0588e704fd already deleted. [ 668.187848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3a6db16-e282-4656-8702-ff0588e704fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.668044] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 672.668435] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 677.669262] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 677.669587] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 682.670627] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 682.671041] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 683.892237] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.892671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.892671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.892671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.892895] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.395779] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.898724] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.400934] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 685.401086] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 686.082268] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.082708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.082708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.082708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.094405] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 686.095183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.095759] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 686.111328] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.111458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.111535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.111698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.111779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.111881] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 686.111952] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 686.112033] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 686.129848] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.130009] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.130067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.130244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.130376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.130482] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 686.147329] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.147456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.147498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.147671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.147767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.147866] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 686.165224] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.165396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.165396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.165585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.165682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.165789] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 686.165860] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 686.165930] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 686.181144] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.181271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.181342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.181512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.181630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.181824] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 686.181884] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 686.181975] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 686.201365] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.201510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.201549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.201695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.201785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.201891] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 686.201954] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 686.202028] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 686.202088] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 686.202158] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 686.202250] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 686.202314] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 686.202560] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 686.202624] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 686.202691] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 686.218856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.218971] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.219050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.219216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.219312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.219410] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 686.235237] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.235394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.235456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.235573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.235666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.284233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.671518] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 687.671928] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 692.672787] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 692.673378] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 697.674610] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 697.674610] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 699.601887] env[62620]: INFO networking_nsxv3.common.synchronization [None req-40bc592d-c2d4-48c9-abbd-7af83f5fd0db None None] Enqueued Resource ID: 7c3a0513-b149-4755-bc3c-0bc7166fbeb8 with Priority: HIGHEST for action port [ 699.602210] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c3a0513-b149-4755-bc3c-0bc7166fbeb8 with Priority: HIGHEST for action port [ 699.602969] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c3a0513-b149-4755-bc3c-0bc7166fbeb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.603263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c3a0513-b149-4755-bc3c-0bc7166fbeb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.603263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c3a0513-b149-4755-bc3c-0bc7166fbeb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.603983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c3a0513-b149-4755-bc3c-0bc7166fbeb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.603983] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c3a0513-b149-4755-bc3c-0bc7166fbeb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.837663] env[62620]: INFO networking_nsxv3.common.synchronization [None req-04e0ad77-e544-4947-9ca9-a9fc3279eb83 None None] Enqueued Resource ID: de24ea47-b0e8-45ea-8131-77aa8e817316 with Priority: HIGHEST for action port [ 699.837710] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de24ea47-b0e8-45ea-8131-77aa8e817316 with Priority: HIGHEST for action port [ 699.839276] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-de24ea47-b0e8-45ea-8131-77aa8e817316 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.839276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de24ea47-b0e8-45ea-8131-77aa8e817316" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.839643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de24ea47-b0e8-45ea-8131-77aa8e817316" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.839643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de24ea47-b0e8-45ea-8131-77aa8e817316" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.839712] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de24ea47-b0e8-45ea-8131-77aa8e817316',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.105635] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c3a0513-b149-4755-bc3c-0bc7166fbeb8 [ 700.106925] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.106925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.107124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.107242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.107329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.107423] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c3a0513-b149-4755-bc3c-0bc7166fbeb8 already deleted. [ 700.107503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c3a0513-b149-4755-bc3c-0bc7166fbeb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.342401] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de24ea47-b0e8-45ea-8131-77aa8e817316 [ 700.345163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.345163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.345163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.345163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.345163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.345163] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de24ea47-b0e8-45ea-8131-77aa8e817316 already deleted. [ 700.345163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de24ea47-b0e8-45ea-8131-77aa8e817316" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.265785] env[62620]: INFO networking_nsxv3.common.synchronization [None req-5d657829-8921-414c-bbb5-954e28c31da4 None None] Enqueued Resource ID: 4773d595-3174-4134-ad96-f03762950de1 with Priority: HIGHEST for action port [ 702.265785] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4773d595-3174-4134-ad96-f03762950de1 with Priority: HIGHEST for action port [ 702.266705] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4773d595-3174-4134-ad96-f03762950de1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.266850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4773d595-3174-4134-ad96-f03762950de1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.266850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4773d595-3174-4134-ad96-f03762950de1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.267257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4773d595-3174-4134-ad96-f03762950de1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.267257] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4773d595-3174-4134-ad96-f03762950de1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.311545] env[62620]: INFO networking_nsxv3.common.synchronization [None req-c7352972-85f2-4fe6-8555-bf74e9a7ae5b None None] Enqueued Resource ID: b72c9e2d-b7f2-40f0-b168-16f3061b1f10 with Priority: HIGHEST for action port [ 702.314118] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72c9e2d-b7f2-40f0-b168-16f3061b1f10 with Priority: HIGHEST for action port [ 702.314118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-b72c9e2d-b7f2-40f0-b168-16f3061b1f10 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.314118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b72c9e2d-b7f2-40f0-b168-16f3061b1f10" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.314118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b72c9e2d-b7f2-40f0-b168-16f3061b1f10" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.316672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b72c9e2d-b7f2-40f0-b168-16f3061b1f10" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.316672] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72c9e2d-b7f2-40f0-b168-16f3061b1f10',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.590591] env[62620]: INFO networking_nsxv3.common.synchronization [None req-ca13236a-99a2-4512-bcf2-a8fbf130f1cc None None] Enqueued Resource ID: daef26e4-071a-4ee1-b807-c127926c0b1b with Priority: HIGHEST for action port [ 702.591605] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef26e4-071a-4ee1-b807-c127926c0b1b with Priority: HIGHEST for action port [ 702.592583] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-daef26e4-071a-4ee1-b807-c127926c0b1b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.593253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-daef26e4-071a-4ee1-b807-c127926c0b1b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.593253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-daef26e4-071a-4ee1-b807-c127926c0b1b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.593390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-daef26e4-071a-4ee1-b807-c127926c0b1b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.593467] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('daef26e4-071a-4ee1-b807-c127926c0b1b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.769892] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4773d595-3174-4134-ad96-f03762950de1 [ 702.770078] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.770470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.770470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.770610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.770664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.771041] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4773d595-3174-4134-ad96-f03762950de1 already deleted. [ 702.771041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4773d595-3174-4134-ad96-f03762950de1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.820944] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b72c9e2d-b7f2-40f0-b168-16f3061b1f10 [ 702.821206] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.821811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.821890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.823382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.823382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.823382] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b72c9e2d-b7f2-40f0-b168-16f3061b1f10 already deleted. [ 702.823382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b72c9e2d-b7f2-40f0-b168-16f3061b1f10" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.098066] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port daef26e4-071a-4ee1-b807-c127926c0b1b [ 703.098374] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.098704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.098816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.098988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.099086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.099180] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:daef26e4-071a-4ee1-b807-c127926c0b1b already deleted. [ 703.099261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-daef26e4-071a-4ee1-b807-c127926c0b1b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.110156] env[62620]: INFO networking_nsxv3.common.synchronization [None req-28ab1215-84f8-4187-a721-3b6a070d2228 None None] Enqueued Resource ID: a13df335-40b0-42e5-a952-2acf10100bd1 with Priority: HIGHEST for action port [ 703.110421] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a13df335-40b0-42e5-a952-2acf10100bd1 with Priority: HIGHEST for action port [ 703.111015] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a13df335-40b0-42e5-a952-2acf10100bd1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.111147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a13df335-40b0-42e5-a952-2acf10100bd1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.111218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a13df335-40b0-42e5-a952-2acf10100bd1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.111467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a13df335-40b0-42e5-a952-2acf10100bd1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.111554] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a13df335-40b0-42e5-a952-2acf10100bd1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.249087] env[62620]: INFO networking_nsxv3.common.synchronization [None req-f2560ecb-c0e1-4059-b2f1-11354c31f6ce None None] Enqueued Resource ID: 84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984 with Priority: HIGHEST for action port [ 703.249667] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984 with Priority: HIGHEST for action port [ 703.249986] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.250161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.250236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.250590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.250590] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.616262] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a13df335-40b0-42e5-a952-2acf10100bd1 [ 703.616518] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.616518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.616690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.617748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.618540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.618540] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a13df335-40b0-42e5-a952-2acf10100bd1 already deleted. [ 703.618540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a13df335-40b0-42e5-a952-2acf10100bd1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.756580] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984 [ 703.757161] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.757361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.757514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.757716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.757853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.758108] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984 already deleted. [ 703.758233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84fdb8ef-b7b0-4ddb-8db1-5f5d9015f984" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.611362] env[62620]: INFO networking_nsxv3.common.synchronization [None req-a3095e1a-b173-49b0-9997-fffebaa4f421 None None] Enqueued Resource ID: 47543781-b92a-459c-be55-4f42a0631749 with Priority: HIGHEST for action port [ 704.611964] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47543781-b92a-459c-be55-4f42a0631749 with Priority: HIGHEST for action port [ 704.612318] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-47543781-b92a-459c-be55-4f42a0631749 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.616096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47543781-b92a-459c-be55-4f42a0631749" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.616096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47543781-b92a-459c-be55-4f42a0631749" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.616096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47543781-b92a-459c-be55-4f42a0631749" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.616096] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47543781-b92a-459c-be55-4f42a0631749',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.021708] env[62620]: INFO networking_nsxv3.common.synchronization [None req-27e59784-7426-45a3-9e13-e5215f887918 None None] Enqueued Resource ID: d0061ac7-aa6c-4547-a867-c737ef282783 with Priority: HIGHEST for action port [ 705.023081] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0061ac7-aa6c-4547-a867-c737ef282783 with Priority: HIGHEST for action port [ 705.023329] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0061ac7-aa6c-4547-a867-c737ef282783 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.023329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0061ac7-aa6c-4547-a867-c737ef282783" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.023548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0061ac7-aa6c-4547-a867-c737ef282783" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.023676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0061ac7-aa6c-4547-a867-c737ef282783" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.023764] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0061ac7-aa6c-4547-a867-c737ef282783',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.117276] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47543781-b92a-459c-be55-4f42a0631749 [ 705.117523] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.117660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.117730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.118978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.118978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.118978] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47543781-b92a-459c-be55-4f42a0631749 already deleted. [ 705.118978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47543781-b92a-459c-be55-4f42a0631749" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.526032] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0061ac7-aa6c-4547-a867-c737ef282783 [ 705.526236] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.526376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.526449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.526670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.526759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.526854] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0061ac7-aa6c-4547-a867-c737ef282783 already deleted. [ 705.526934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0061ac7-aa6c-4547-a867-c737ef282783" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.692419] env[62620]: INFO networking_nsxv3.common.synchronization [None req-36d8aa67-a897-463f-a0de-bc81b9ec8367 None None] Enqueued Resource ID: 1bf66857-443f-45ff-9da2-6c4e14213b1e with Priority: HIGHEST for action port [ 705.695058] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf66857-443f-45ff-9da2-6c4e14213b1e with Priority: HIGHEST for action port [ 705.695058] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bf66857-443f-45ff-9da2-6c4e14213b1e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.695058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bf66857-443f-45ff-9da2-6c4e14213b1e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.695058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bf66857-443f-45ff-9da2-6c4e14213b1e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.695058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bf66857-443f-45ff-9da2-6c4e14213b1e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.695058] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bf66857-443f-45ff-9da2-6c4e14213b1e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.196594] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bf66857-443f-45ff-9da2-6c4e14213b1e [ 706.196835] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.196966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.196966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.198691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.198691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.198691] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bf66857-443f-45ff-9da2-6c4e14213b1e already deleted. [ 706.198691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bf66857-443f-45ff-9da2-6c4e14213b1e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.718414] env[62620]: INFO networking_nsxv3.common.synchronization [None req-8dba4c44-f9be-4e84-9236-09db299836ed None None] Enqueued Resource ID: 5d8cec6a-14f7-44c1-b87d-b45fe586e785 with Priority: HIGHEST for action port [ 706.718414] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d8cec6a-14f7-44c1-b87d-b45fe586e785 with Priority: HIGHEST for action port [ 706.718414] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d8cec6a-14f7-44c1-b87d-b45fe586e785 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.718414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d8cec6a-14f7-44c1-b87d-b45fe586e785" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.718414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d8cec6a-14f7-44c1-b87d-b45fe586e785" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.718414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d8cec6a-14f7-44c1-b87d-b45fe586e785" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.718414] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d8cec6a-14f7-44c1-b87d-b45fe586e785',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.742153] env[62620]: INFO networking_nsxv3.common.synchronization [None req-aaa71e2f-8da9-48dc-a44f-c0c1b12628f5 None None] Enqueued Resource ID: 2b5ae807-91e0-46b1-9d29-19c33b88c1d0 with Priority: HIGHEST for action port [ 706.742864] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5ae807-91e0-46b1-9d29-19c33b88c1d0 with Priority: HIGHEST for action port [ 706.742864] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b5ae807-91e0-46b1-9d29-19c33b88c1d0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.743036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b5ae807-91e0-46b1-9d29-19c33b88c1d0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.743036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b5ae807-91e0-46b1-9d29-19c33b88c1d0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.744336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b5ae807-91e0-46b1-9d29-19c33b88c1d0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.744473] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5ae807-91e0-46b1-9d29-19c33b88c1d0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.223404] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d8cec6a-14f7-44c1-b87d-b45fe586e785 [ 707.223668] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.223810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.223877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.224118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.224302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.224302] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d8cec6a-14f7-44c1-b87d-b45fe586e785 already deleted. [ 707.224388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d8cec6a-14f7-44c1-b87d-b45fe586e785" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.248214] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b5ae807-91e0-46b1-9d29-19c33b88c1d0 [ 707.248214] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.248312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.248312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.248499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.248582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.248675] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b5ae807-91e0-46b1-9d29-19c33b88c1d0 already deleted. [ 707.248754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b5ae807-91e0-46b1-9d29-19c33b88c1d0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.861673] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b6ddf3e0-9686-4680-a233-14e4e4e265db None None] Enqueued Resource ID: 542d8b0a-3482-40b0-9a08-7c214485cae2 with Priority: HIGHEST for action port [ 708.862065] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542d8b0a-3482-40b0-9a08-7c214485cae2 with Priority: HIGHEST for action port [ 708.862356] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-542d8b0a-3482-40b0-9a08-7c214485cae2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.863110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-542d8b0a-3482-40b0-9a08-7c214485cae2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.863110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-542d8b0a-3482-40b0-9a08-7c214485cae2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.863296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-542d8b0a-3482-40b0-9a08-7c214485cae2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.863359] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('542d8b0a-3482-40b0-9a08-7c214485cae2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.938266] env[62620]: INFO networking_nsxv3.common.synchronization [None req-73d48f5e-8812-4491-9b08-b0154fc163e5 None None] Enqueued Resource ID: ef1408ae-0934-4122-aae2-418e78718318 with Priority: HIGHEST for action port [ 708.938266] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1408ae-0934-4122-aae2-418e78718318 with Priority: HIGHEST for action port [ 708.938334] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef1408ae-0934-4122-aae2-418e78718318 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.938408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef1408ae-0934-4122-aae2-418e78718318" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.938486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef1408ae-0934-4122-aae2-418e78718318" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.938734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef1408ae-0934-4122-aae2-418e78718318" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.939319] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef1408ae-0934-4122-aae2-418e78718318',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.175187] env[62620]: INFO networking_nsxv3.common.synchronization [None req-9a2859ae-0830-433e-b9da-155648a90e04 tempest-ServersTestBootFromVolume-172209119 tempest-ServersTestBootFromVolume-172209119-project-member] Enqueued Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_rules [ 709.175187] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_rules [ 709.175187] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.175187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.175187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.175187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.175187] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.366048] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 542d8b0a-3482-40b0-9a08-7c214485cae2 [ 709.366781] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.367688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.367688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.367688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.367688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.367688] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:542d8b0a-3482-40b0-9a08-7c214485cae2 already deleted. [ 709.367688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-542d8b0a-3482-40b0-9a08-7c214485cae2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.442594] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef1408ae-0934-4122-aae2-418e78718318 [ 709.443061] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.443283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.443379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.443695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.444078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.444238] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef1408ae-0934-4122-aae2-418e78718318 already deleted. [ 709.444358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef1408ae-0934-4122-aae2-418e78718318" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.539296] env[62620]: INFO networking_nsxv3.common.synchronization [None req-71db5173-6a75-4cd7-847a-bafb329f5266 tempest-ServersTestBootFromVolume-172209119 tempest-ServersTestBootFromVolume-172209119-project-member] Enqueued Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_rules [ 709.539866] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_rules [ 709.540112] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.540259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.694833] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.694982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.695068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.695280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.695374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.695469] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e already deleted. [ 709.695566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.695714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.695871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.695955] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.216694] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.216694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.216694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.216694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.216694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.216694] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e already deleted. [ 710.216694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.286049] env[62620]: INFO networking_nsxv3.common.synchronization [None req-982fb863-9e37-4d34-a48a-bc197484339d None None] Enqueued Resource ID: 113bcf21-5fe0-48da-a85b-6f91b286d6bb with Priority: HIGHEST for action port [ 710.286595] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 113bcf21-5fe0-48da-a85b-6f91b286d6bb with Priority: HIGHEST for action port [ 710.286918] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-113bcf21-5fe0-48da-a85b-6f91b286d6bb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.287336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-113bcf21-5fe0-48da-a85b-6f91b286d6bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.287407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-113bcf21-5fe0-48da-a85b-6f91b286d6bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.287642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-113bcf21-5fe0-48da-a85b-6f91b286d6bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.287729] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('113bcf21-5fe0-48da-a85b-6f91b286d6bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.792373] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 113bcf21-5fe0-48da-a85b-6f91b286d6bb [ 710.792373] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.792373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.792373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.792373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.792373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.792373] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:113bcf21-5fe0-48da-a85b-6f91b286d6bb already deleted. [ 710.792373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-113bcf21-5fe0-48da-a85b-6f91b286d6bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.912023] env[62620]: INFO networking_nsxv3.common.synchronization [None req-317bc56e-b2e0-4776-8e21-c2f7976ebb72 None None] Enqueued Resource ID: 140422ee-32a3-40d9-b460-d9f4f3b0da13 with Priority: HIGHEST for action port [ 710.912023] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140422ee-32a3-40d9-b460-d9f4f3b0da13 with Priority: HIGHEST for action port [ 710.912023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-140422ee-32a3-40d9-b460-d9f4f3b0da13 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.912023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-140422ee-32a3-40d9-b460-d9f4f3b0da13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.912023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-140422ee-32a3-40d9-b460-d9f4f3b0da13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.912382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-140422ee-32a3-40d9-b460-d9f4f3b0da13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.912624] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('140422ee-32a3-40d9-b460-d9f4f3b0da13',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.419277] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 140422ee-32a3-40d9-b460-d9f4f3b0da13 [ 711.419277] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.419277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.419277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.419277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.419277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.419277] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:140422ee-32a3-40d9-b460-d9f4f3b0da13 already deleted. [ 711.419277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-140422ee-32a3-40d9-b460-d9f4f3b0da13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.338314] env[62620]: INFO networking_nsxv3.common.synchronization [req-ea905dee-4f2e-4aa9-8b62-5d5d5c044bea req-13329d78-70e8-4fd8-9cc2-8e5a5b1759c0 tempest-DeleteServersAdminTestJSON-1615940801 tempest-DeleteServersAdminTestJSON-1615940801-project-member] Enqueued Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 712.338835] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 712.339144] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.339266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.339332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.340321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.340476] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.340536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.340603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.340761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.340835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.340901] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.403731] env[62620]: INFO networking_nsxv3.common.synchronization [None req-90e6d659-5c20-4ec9-b8bc-e3ed91b72550 None None] Enqueued Resource ID: 8d80bd2e-066f-4f8f-8357-828c73d5d1f4 with Priority: HIGHEST for action port [ 712.403731] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d80bd2e-066f-4f8f-8357-828c73d5d1f4 with Priority: HIGHEST for action port [ 712.403731] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d80bd2e-066f-4f8f-8357-828c73d5d1f4 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.403731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d80bd2e-066f-4f8f-8357-828c73d5d1f4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.403731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d80bd2e-066f-4f8f-8357-828c73d5d1f4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.403731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d80bd2e-066f-4f8f-8357-828c73d5d1f4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.403731] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d80bd2e-066f-4f8f-8357-828c73d5d1f4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.515109] env[62620]: INFO networking_nsxv3.common.synchronization [None req-8dbc0049-8eda-4cf6-bb7d-cc8751abd08b None None] Enqueued Resource ID: 3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a with Priority: HIGHEST for action port [ 712.516156] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a with Priority: HIGHEST for action port [ 712.516392] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.516570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.516674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.516976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.517248] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.844772] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.844772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.844772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.844772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.844772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.844772] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.844772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.844772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.844772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.844772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.844772] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 already deleted. [ 712.844772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.905246] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d80bd2e-066f-4f8f-8357-828c73d5d1f4 [ 712.905246] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.905246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.905246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.905246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.905246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.905246] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d80bd2e-066f-4f8f-8357-828c73d5d1f4 already deleted. [ 712.907425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d80bd2e-066f-4f8f-8357-828c73d5d1f4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.019507] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a [ 713.019640] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.019768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.019844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.020070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.020272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.020272] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a already deleted. [ 713.020358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e14a352-a3f6-4c48-a54d-d8cdb64f3a5a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.307776] env[62620]: INFO networking_nsxv3.common.synchronization [None req-38453597-0e3f-4d5b-a6a0-7f0692e2d154 None None] Enqueued Resource ID: 3b1f9832-da20-4fe9-aaba-634e8ade287f with Priority: HIGHEST for action port [ 713.307776] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b1f9832-da20-4fe9-aaba-634e8ade287f with Priority: HIGHEST for action port [ 713.307776] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b1f9832-da20-4fe9-aaba-634e8ade287f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.307776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b1f9832-da20-4fe9-aaba-634e8ade287f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.307776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b1f9832-da20-4fe9-aaba-634e8ade287f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.307776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b1f9832-da20-4fe9-aaba-634e8ade287f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.307776] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b1f9832-da20-4fe9-aaba-634e8ade287f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.810644] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b1f9832-da20-4fe9-aaba-634e8ade287f [ 713.811028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.811384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.811466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.811674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.811767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.811943] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b1f9832-da20-4fe9-aaba-634e8ade287f already deleted. [ 713.811943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b1f9832-da20-4fe9-aaba-634e8ade287f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.838336] env[62620]: INFO networking_nsxv3.common.synchronization [None req-ba4e7091-4019-4dc7-a365-1ea12fcaaca2 None None] Enqueued Resource ID: 1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c with Priority: HIGHEST for action port [ 713.838336] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c with Priority: HIGHEST for action port [ 713.838336] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.838336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.839307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.840473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.840681] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.906749] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.907237] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.907398] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.907703] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.908440] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.908944] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.909106] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.909622] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.909622] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.910130] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.910212] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.910529] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.910853] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.911013] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.911145] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.911291] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.931439] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.932077] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.932077] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.932269] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.932681] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-a1a51631-0dc2-427d-a041-f4c9f944ea3d taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.933073] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-a1a51631-0dc2-427d-a041-f4c9f944ea3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.933307] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-a1a51631-0dc2-427d-a041-f4c9f944ea3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.933555] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-a1a51631-0dc2-427d-a041-f4c9f944ea3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.934350] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a51631-0dc2-427d-a041-f4c9f944ea3d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.346183] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c [ 714.346183] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.346183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.346183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.346183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.346183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.346183] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c already deleted. [ 714.346183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f9ae0bc-7ab0-4f85-9ec9-1840ab8f9d9c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.437944] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.438311] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.438498] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.438865] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.439083] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.439321] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port a1a51631-0dc2-427d-a041-f4c9f944ea3d not found, creating... [ 714.439669] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.439896] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.440100] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.440410] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.440612] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.441062] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.441403] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.442525] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.442525] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.442525] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.442525] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: a1a51631-0dc2-427d-a041-f4c9f944ea3d is going to be created. [ 714.466041] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.466041] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.466041] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.466041] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.466041] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.466041] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-a1a51631-0dc2-427d-a041-f4c9f944ea3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.598053] env[62620]: INFO networking_nsxv3.common.synchronization [req-79d9156d-fb45-40fb-9316-ac3a359e1d1c req-003b41d9-44d3-4e41-b92f-98d8bae4960e tempest-ServersAdminNegativeTestJSON-337070548 tempest-ServersAdminNegativeTestJSON-337070548-project-member] Enqueued Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 714.598716] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 714.598884] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.599037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.601709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.601709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.601709] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.601709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.601709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.601709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.601709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.601709] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.102924] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.103385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.103385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.104788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.104903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.105204] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.105280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.105313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.105496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.105593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.105662] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 already deleted. [ 715.105742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.218392] env[62620]: INFO networking_nsxv3.common.synchronization [None req-5f765e00-7eaa-4964-8d74-01cbb310279a None None] Enqueued Resource ID: 8861da50-a506-4003-89d3-087d34e58f2b with Priority: HIGHEST for action port [ 715.218979] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8861da50-a506-4003-89d3-087d34e58f2b with Priority: HIGHEST for action port [ 715.219326] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8861da50-a506-4003-89d3-087d34e58f2b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.219452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8861da50-a506-4003-89d3-087d34e58f2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.219719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8861da50-a506-4003-89d3-087d34e58f2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.222062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8861da50-a506-4003-89d3-087d34e58f2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.222154] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8861da50-a506-4003-89d3-087d34e58f2b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.290843] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.291145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.291334] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.291561] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.291924] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.292102] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.292225] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.292619] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.292766] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.292976] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.293102] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.293453] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.293656] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.293734] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.293845] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.293984] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.312953] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.313568] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.313568] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.313568] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.313866] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.313987] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.314059] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.314333] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.314496] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.680058] env[62620]: INFO networking_nsxv3.common.synchronization [req-ea905dee-4f2e-4aa9-8b62-5d5d5c044bea req-092cf1f9-d2e9-42d4-a83c-93c0fe8f5fdf service nova] Enqueued Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_rules [ 715.680275] env[62620]: INFO networking_nsxv3.common.synchronization [req-ea905dee-4f2e-4aa9-8b62-5d5d5c044bea req-092cf1f9-d2e9-42d4-a83c-93c0fe8f5fdf service nova] Enqueued Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 715.680468] env[62620]: INFO networking_nsxv3.common.synchronization [req-ea905dee-4f2e-4aa9-8b62-5d5d5c044bea req-092cf1f9-d2e9-42d4-a83c-93c0fe8f5fdf service nova] Enqueued Resource ID: a1a51631-0dc2-427d-a041-f4c9f944ea3d with Priority: HIGHEST for action port [ 715.681315] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_rules [ 715.681315] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 715.681315] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51631-0dc2-427d-a041-f4c9f944ea3d with Priority: HIGHEST for action port [ 715.681884] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.682032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.682122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.682724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.682724] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.683375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.683509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.683588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.683842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.683928] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.684037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.684103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.684249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.684340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.684421] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.686332] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1a51631-0dc2-427d-a041-f4c9f944ea3d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.686456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1a51631-0dc2-427d-a041-f4c9f944ea3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.686520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1a51631-0dc2-427d-a041-f4c9f944ea3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.686654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1a51631-0dc2-427d-a041-f4c9f944ea3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.689095] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a51631-0dc2-427d-a041-f4c9f944ea3d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.724192] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8861da50-a506-4003-89d3-087d34e58f2b [ 715.724630] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.725055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.725366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.725475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.725606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.725749] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8861da50-a506-4003-89d3-087d34e58f2b already deleted. [ 715.726050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8861da50-a506-4003-89d3-087d34e58f2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.819225] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.819954] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.820282] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.820490] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.820699] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.820840] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7 not found, creating... [ 715.821143] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.822387] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.822387] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.822387] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.822387] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.823192] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.823384] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.823510] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.823736] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.823874] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.824219] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7 is going to be created. [ 715.843109] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.843325] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.843452] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.843737] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.843970] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.844215] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.189843] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.190232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.200646] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1a51631-0dc2-427d-a041-f4c9f944ea3d with status ACTIVE [ 716.200851] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.200999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.201085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.201312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.201408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.201583] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.201688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.201753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.201907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.201986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.202184] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.202283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.202345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.202530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.202625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.202713] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1a51631-0dc2-427d-a041-f4c9f944ea3d is going to be updated. [ 716.206711] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.227994] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.228447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.228557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.228847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.229173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.229512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1a51631-0dc2-427d-a041-f4c9f944ea3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.709560] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.761733] env[62620]: INFO networking_nsxv3.common.synchronization [None req-cc569d6e-f23a-4902-a6fa-0bff27407a87 None None] Enqueued Resource ID: 8d8099d9-d97a-4e43-ab7e-029f91dc3af7 with Priority: HIGHEST for action port [ 716.761733] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d8099d9-d97a-4e43-ab7e-029f91dc3af7 with Priority: HIGHEST for action port [ 716.761733] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d8099d9-d97a-4e43-ab7e-029f91dc3af7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.761733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d8099d9-d97a-4e43-ab7e-029f91dc3af7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.761733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d8099d9-d97a-4e43-ab7e-029f91dc3af7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.761733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d8099d9-d97a-4e43-ab7e-029f91dc3af7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.761733] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d8099d9-d97a-4e43-ab7e-029f91dc3af7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.212364] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.212740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.212740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.212805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.212904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.213008] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 is going to be created. [ 717.245107] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.245242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.245242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.245484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.245563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.257086] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: UNINITIALIZED for 2s [ 717.265592] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d8099d9-d97a-4e43-ab7e-029f91dc3af7 [ 717.265768] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.267015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.267015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.267015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.267015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.267015] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d8099d9-d97a-4e43-ab7e-029f91dc3af7 already deleted. [ 717.267015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d8099d9-d97a-4e43-ab7e-029f91dc3af7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.542391] env[62620]: INFO networking_nsxv3.common.synchronization [req-819b612f-52bd-4499-b82b-186d49c18c06 req-af54056e-37d2-4946-b972-83e719214f85 tempest-ServerDiagnosticsNegativeTest-1603042516 tempest-ServerDiagnosticsNegativeTest-1603042516-project-member] Enqueued Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGHEST for action security_group_members [ 717.542742] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGHEST for action security_group_members [ 717.543217] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c496017c-beee-4fd7-8921-2f61e9ddb89b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.543419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.543485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.543873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.544775] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.544775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.544775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.544775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.544775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.544775] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c496017c-beee-4fd7-8921-2f61e9ddb89b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.580814] env[62620]: INFO networking_nsxv3.common.synchronization [req-79d9156d-fb45-40fb-9316-ac3a359e1d1c req-e639d447-96db-40b4-9aae-5594513d04cd service nova] Enqueued Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_rules [ 717.580814] env[62620]: INFO networking_nsxv3.common.synchronization [req-79d9156d-fb45-40fb-9316-ac3a359e1d1c req-e639d447-96db-40b4-9aae-5594513d04cd service nova] Enqueued Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 717.580814] env[62620]: INFO networking_nsxv3.common.synchronization [req-79d9156d-fb45-40fb-9316-ac3a359e1d1c req-e639d447-96db-40b4-9aae-5594513d04cd service nova] Enqueued Resource ID: 79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7 with Priority: HIGHEST for action port [ 717.582296] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_rules [ 717.582843] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 717.582843] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7 with Priority: HIGHEST for action port [ 717.582843] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.583047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.583047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.583286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.583365] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.584265] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.584332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.584711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.584711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.584711] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.584990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.584990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.584990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.585148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.585148] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.585926] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.586318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.586318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.586318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.586438] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.047761] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.048016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.048016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.048257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.048350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.049285] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.049285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.049285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.049285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.049285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.049285] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c496017c-beee-4fd7-8921-2f61e9ddb89b already deleted. [ 718.049285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.088973] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.089130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.089269] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7 with status ACTIVE [ 718.089434] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.089536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.089596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.089868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.089931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.090072] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.090155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.094019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.094019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.094019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.094019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.094019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.094019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.094019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.094019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.094019] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7 is going to be updated. [ 718.094476] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.115544] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.116155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.116680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.117087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.118760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.118760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79ffbb02-e48b-42f6-a1c3-8f9a38f02aa7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.205498] env[62620]: INFO networking_nsxv3.common.synchronization [None req-0b375348-e9bd-438c-b438-a01848731fa3 None None] Enqueued Resource ID: 203fb4ff-b950-421b-8c08-56a7b1414a62 with Priority: HIGHEST for action port [ 718.205498] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 203fb4ff-b950-421b-8c08-56a7b1414a62 with Priority: HIGHEST for action port [ 718.205498] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-203fb4ff-b950-421b-8c08-56a7b1414a62 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.206527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-203fb4ff-b950-421b-8c08-56a7b1414a62" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.206903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-203fb4ff-b950-421b-8c08-56a7b1414a62" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.208273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-203fb4ff-b950-421b-8c08-56a7b1414a62" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.208273] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('203fb4ff-b950-421b-8c08-56a7b1414a62',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.598244] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.713386] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 203fb4ff-b950-421b-8c08-56a7b1414a62 [ 718.713386] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.713538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.713949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.714142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.714142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.714211] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:203fb4ff-b950-421b-8c08-56a7b1414a62 already deleted. [ 718.714285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-203fb4ff-b950-421b-8c08-56a7b1414a62" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.766791] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.766791] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.766791] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.766791] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.767463] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.767980] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.768350] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.769493] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.769493] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.769628] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.769754] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.769869] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.770018] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.770139] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.770250] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.770388] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.789725] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.789885] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 718.790100] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.791025] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.791025] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-db80642f-6b36-430d-badf-9ba7dacbbad6 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.791372] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-db80642f-6b36-430d-badf-9ba7dacbbad6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.792115] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-db80642f-6b36-430d-badf-9ba7dacbbad6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.792115] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-db80642f-6b36-430d-badf-9ba7dacbbad6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.792115] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db80642f-6b36-430d-badf-9ba7dacbbad6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.994652] env[62620]: INFO networking_nsxv3.common.synchronization [None req-a4d44da7-af14-47fd-8ee6-85afca080abb None None] Enqueued Resource ID: dbf4e931-2aa5-4025-b3bc-b0402c76e511 with Priority: HIGHEST for action port [ 718.994911] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf4e931-2aa5-4025-b3bc-b0402c76e511 with Priority: HIGHEST for action port [ 718.995718] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbf4e931-2aa5-4025-b3bc-b0402c76e511 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.995718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbf4e931-2aa5-4025-b3bc-b0402c76e511" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.995718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbf4e931-2aa5-4025-b3bc-b0402c76e511" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.995974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbf4e931-2aa5-4025-b3bc-b0402c76e511" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.997729] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf4e931-2aa5-4025-b3bc-b0402c76e511',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.059142] env[62620]: INFO networking_nsxv3.common.synchronization [req-630748af-c360-409a-9443-501eb2c40da1 req-fa98e027-4b1b-456e-b50d-f677b0e0cc20 tempest-FloatingIPsAssociationTestJSON-1435038635 tempest-FloatingIPsAssociationTestJSON-1435038635-project-member] Enqueued Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 719.059142] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 719.059142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.059142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.059142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.059142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.059142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.059142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.063526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.063526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.063526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.063526] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.102104] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.102847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.102938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.103241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.103296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.103353] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 is going to be created. [ 719.127688] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.127835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.127895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.128125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.128277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.138346] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: UNINITIALIZED for 2s [ 719.270599] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: SUCCESS [ 719.270599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.270599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.270599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.270599] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.270599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.270599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.270599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.270599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.270599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.270599] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.295540] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.295752] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.295820] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.296119] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.296340] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.296426] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port db80642f-6b36-430d-badf-9ba7dacbbad6 not found, creating... [ 719.296690] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.296855] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.296981] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.297628] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.297778] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.298361] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.298531] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.298758] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.298871] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.299244] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.299394] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: db80642f-6b36-430d-badf-9ba7dacbbad6 is going to be created. [ 719.324442] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.324442] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.324442] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.324442] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.324442] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.324442] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-db80642f-6b36-430d-badf-9ba7dacbbad6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.501222] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbf4e931-2aa5-4025-b3bc-b0402c76e511 [ 719.502919] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.502919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.502919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.502919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.502919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.502919] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbf4e931-2aa5-4025-b3bc-b0402c76e511 already deleted. [ 719.502919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbf4e931-2aa5-4025-b3bc-b0402c76e511" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.567988] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.568190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.568237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.568820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.568820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.568820] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.568820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.569027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.569027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.569102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.569192] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 already deleted. [ 719.569244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.749073] env[62620]: INFO networking_nsxv3.common.synchronization [None req-1b8e5625-9b71-4143-b5b4-d699b5f57ce2 None None] Enqueued Resource ID: 279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a with Priority: HIGHEST for action port [ 719.749073] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a with Priority: HIGHEST for action port [ 719.749073] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.749073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.749073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.750434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.750577] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.776429] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.776573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.776573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.776819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.777533] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.777533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.777533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.777533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.777533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.777533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.777863] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.777863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.777863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.777863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.778081] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.780235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.780427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.780483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.780682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.780682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.780781] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.831684] env[62620]: INFO networking_nsxv3.common.synchronization [None req-98bc37e7-929d-4320-b17f-16e532942e65 None None] Enqueued Resource ID: cff69c2d-367e-4a70-8051-b1753a918e0e with Priority: HIGHEST for action port [ 719.831792] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff69c2d-367e-4a70-8051-b1753a918e0e with Priority: HIGHEST for action port [ 719.832348] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-cff69c2d-367e-4a70-8051-b1753a918e0e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.832490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cff69c2d-367e-4a70-8051-b1753a918e0e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.832575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cff69c2d-367e-4a70-8051-b1753a918e0e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.832847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cff69c2d-367e-4a70-8051-b1753a918e0e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.832922] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cff69c2d-367e-4a70-8051-b1753a918e0e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.229021] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-176 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.229021] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-176" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.229021] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-176" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.229305] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-176" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.229584] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.229750] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.229891] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.230142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.230309] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.230638] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.230704] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.230837] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.230992] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.231148] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.231322] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.231403] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.258146] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a [ 720.258304] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.260040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.260040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.260040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.260040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.260040] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a already deleted. [ 720.260040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-279ffe2f-edb7-4143-9e9f-ebb98a4c6a2a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.260040] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.263936] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.263936] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.263936] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-176" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.263936] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-246fd9bd-81de-4162-b744-58c17169a80f taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.263936] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-246fd9bd-81de-4162-b744-58c17169a80f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.263936] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-246fd9bd-81de-4162-b744-58c17169a80f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.263936] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-246fd9bd-81de-4162-b744-58c17169a80f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.263936] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('246fd9bd-81de-4162-b744-58c17169a80f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.284118] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7027a4f2-13d4-467a-96da-8c378fa8ac69: rpc.has_security_group_logging(os_id): False [ 720.303222] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.303222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.303222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.303222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.303222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.303222] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.303222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.303222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.303222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.303222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.303886] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.303886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.303886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.303886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.303886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.304055] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.304391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.304391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.304391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.304520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.304520] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 is going to be created. [ 720.338081] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cff69c2d-367e-4a70-8051-b1753a918e0e [ 720.338360] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.338548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.338604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.338885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.338885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.338977] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cff69c2d-367e-4a70-8051-b1753a918e0e already deleted. [ 720.339096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cff69c2d-367e-4a70-8051-b1753a918e0e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.362410] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.362607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.362698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.363029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.363469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.375289] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: IN_PROGRESS for 2s [ 720.431577] env[62620]: INFO networking_nsxv3.common.synchronization [None req-94f2f7df-3856-4f8b-a57f-1826cbd6c30a tempest-VolumesAssistedSnapshotsTest-1178161758 tempest-VolumesAssistedSnapshotsTest-1178161758-project-member] Enqueued Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_rules [ 720.432219] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_rules [ 720.432594] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a6af52c-b1fd-4489-b26c-557260173089 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.432714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.432794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.433408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.433553] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.765424] env[62620]: INFO networking_nsxv3.common.synchronization [None req-f754f01d-a035-4c1f-8076-0355a602b461 tempest-VolumesAssistedSnapshotsTest-1178161758 tempest-VolumesAssistedSnapshotsTest-1178161758-project-member] Enqueued Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_rules [ 720.765424] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_rules [ 720.765424] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a6af52c-b1fd-4489-b26c-557260173089 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.765424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.766809] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.766809] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.766809] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.766984] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.767713] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.767713] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 246fd9bd-81de-4162-b744-58c17169a80f not found, creating... [ 720.767913] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.768108] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.768230] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.768510] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.768670] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.768968] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.769773] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.770344] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.770653] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.770774] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.770977] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 246fd9bd-81de-4162-b744-58c17169a80f is going to be created. [ 720.794393] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.797188] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.797188] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.798069] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.799158] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.799245] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-246fd9bd-81de-4162-b744-58c17169a80f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.977156] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.977352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.977402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.977900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.977900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.977900] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a6af52c-b1fd-4489-b26c-557260173089 already deleted. [ 720.977900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.978143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.978800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.978800] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.148235] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: SUCCESS [ 721.149790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.153591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.153591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.153591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.153591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.153591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.153591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.153591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.154511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.154511] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.221671] env[62620]: INFO networking_nsxv3.common.synchronization [req-819b612f-52bd-4499-b82b-186d49c18c06 req-308643fc-8734-4683-aa35-9e5106241072 service nova] Enqueued Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGHEST for action security_group_rules [ 721.222877] env[62620]: INFO networking_nsxv3.common.synchronization [req-819b612f-52bd-4499-b82b-186d49c18c06 req-308643fc-8734-4683-aa35-9e5106241072 service nova] Enqueued Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGHEST for action security_group_members [ 721.223252] env[62620]: INFO networking_nsxv3.common.synchronization [req-819b612f-52bd-4499-b82b-186d49c18c06 req-308643fc-8734-4683-aa35-9e5106241072 service nova] Enqueued Resource ID: db80642f-6b36-430d-badf-9ba7dacbbad6 with Priority: HIGHEST for action port [ 721.225387] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGHEST for action security_group_rules [ 721.225543] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGHEST for action security_group_members [ 721.226182] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db80642f-6b36-430d-badf-9ba7dacbbad6 with Priority: HIGHEST for action port [ 721.226528] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c496017c-beee-4fd7-8921-2f61e9ddb89b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.226730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.226871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.227166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.227253] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c496017c-beee-4fd7-8921-2f61e9ddb89b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.228152] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c496017c-beee-4fd7-8921-2f61e9ddb89b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.228295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.228373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.228546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.228729] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.228790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.229044] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.229044] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.229142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.229176] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c496017c-beee-4fd7-8921-2f61e9ddb89b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.229917] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-db80642f-6b36-430d-badf-9ba7dacbbad6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.233054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db80642f-6b36-430d-badf-9ba7dacbbad6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.233054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db80642f-6b36-430d-badf-9ba7dacbbad6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.233054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db80642f-6b36-430d-badf-9ba7dacbbad6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.233054] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db80642f-6b36-430d-badf-9ba7dacbbad6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.499869] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.499869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.499869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.500030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.500693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.500693] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a6af52c-b1fd-4489-b26c-557260173089 already deleted. [ 721.500693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.657184] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.657299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.657353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.658299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.658299] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.658299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.658299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.658299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.658299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.658299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.658686] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.659420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.659420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.659420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.659420] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.659420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.659420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.659755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.659839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.659927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.660029] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.735032] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c496017c-beee-4fd7-8921-2f61e9ddb89b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.735032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c496017c-beee-4fd7-8921-2f61e9ddb89b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.735032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.735032] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db80642f-6b36-430d-badf-9ba7dacbbad6 with status ACTIVE [ 721.735032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.735032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.735032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.735032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.735032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.735032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.735032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.735032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.735032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.735032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.736053] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.736266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.736266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.736924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.736924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.736924] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db80642f-6b36-430d-badf-9ba7dacbbad6 is going to be updated. [ 721.778252] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.778252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.778252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.778252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.778252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.778252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db80642f-6b36-430d-badf-9ba7dacbbad6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.900615] env[62620]: INFO networking_nsxv3.common.synchronization [None req-86704b19-b7e2-498c-832f-25617b129411 None None] Enqueued Resource ID: 7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358 with Priority: HIGHEST for action port [ 721.901251] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358 with Priority: HIGHEST for action port [ 721.901576] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.901699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.901765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.902035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.902121] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.166907] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217: rpc.has_security_group_logging(os_id): False [ 722.183382] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.183566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.183646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.183843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.183937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.184150] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.184256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.184316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.184478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.184558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.184757] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.185689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.185770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.186351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.186351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.186351] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.186351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.186351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.186682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.186682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.186682] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 is going to be created. [ 722.241385] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.241556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.241648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.241785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.241969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.244756] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c496017c-beee-4fd7-8921-2f61e9ddb89b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.255508] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: IN_PROGRESS for 2s [ 722.288636] env[62620]: INFO networking_nsxv3.common.synchronization [req-69a0c14a-510b-417d-b71b-41bd6367b703 req-b6b309e8-1a8d-4e3f-bd05-e0d1d2cfcb7f tempest-MigrationsAdminTest-1384528618 tempest-MigrationsAdminTest-1384528618-project-member] Enqueued Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 722.289541] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 722.289676] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.289802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.289869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.290156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.290332] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.290447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.290518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.290678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.291219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.291219] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.390514] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: SUCCESS [ 722.390514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.406022] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358 [ 722.406022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.406022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.406022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.406022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.406022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.406022] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358 already deleted. [ 722.406022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c6fb5fc-b0e1-42ca-9fe9-c17bb937c358" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.605660] env[62620]: INFO networking_nsxv3.common.synchronization [req-630748af-c360-409a-9443-501eb2c40da1 req-9863bdfe-e6b2-4548-9278-7728cbeda305 service nova] Enqueued Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_rules [ 722.605964] env[62620]: INFO networking_nsxv3.common.synchronization [req-630748af-c360-409a-9443-501eb2c40da1 req-9863bdfe-e6b2-4548-9278-7728cbeda305 service nova] Enqueued Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 722.607183] env[62620]: INFO networking_nsxv3.common.synchronization [req-630748af-c360-409a-9443-501eb2c40da1 req-9863bdfe-e6b2-4548-9278-7728cbeda305 service nova] Enqueued Resource ID: 246fd9bd-81de-4162-b744-58c17169a80f with Priority: HIGHEST for action port [ 722.607183] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_rules [ 722.610456] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 722.610456] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246fd9bd-81de-4162-b744-58c17169a80f with Priority: HIGHEST for action port [ 722.610456] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.610456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.610456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.610456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.610456] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.611350] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.611583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.611718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.611975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.612914] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.612914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.612914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.612914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.613231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.613458] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.615197] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-246fd9bd-81de-4162-b744-58c17169a80f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.615355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-246fd9bd-81de-4162-b744-58c17169a80f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.615429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-246fd9bd-81de-4162-b744-58c17169a80f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.616193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-246fd9bd-81de-4162-b744-58c17169a80f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.616193] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('246fd9bd-81de-4162-b744-58c17169a80f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.664378] env[62620]: INFO networking_nsxv3.common.synchronization [None req-40fb93b2-2ed4-4143-be78-325eb1f6685d tempest-ServersTestJSON-774440597 tempest-ServersTestJSON-774440597-project-member] Enqueued Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_rules [ 722.664920] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_rules [ 722.665254] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341c1f60-30e8-4cc4-ae8a-741cd6542553 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.665390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.665458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.666189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.666189] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.748363] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.748725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.748725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.748894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.749108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.749108] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c496017c-beee-4fd7-8921-2f61e9ddb89b is going to be created. [ 722.779537] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.779911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.779911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.779993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.780252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.789503] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c496017c-beee-4fd7-8921-2f61e9ddb89b in Status: UNINITIALIZED for 2s [ 722.793443] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.793602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.793742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.793916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.794020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.794236] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.794365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.794406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.794565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.794660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.794824] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b already deleted. [ 722.794887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.117701] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.117701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.117802] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.118929] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 246fd9bd-81de-4162-b744-58c17169a80f with status ACTIVE [ 723.122928] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.122928] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.122928] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.122928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.122928] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 246fd9bd-81de-4162-b744-58c17169a80f is going to be updated. [ 723.147531] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.147531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.147531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.147849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.147932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.148125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-246fd9bd-81de-4162-b744-58c17169a80f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.151339] env[62620]: INFO networking_nsxv3.common.synchronization [None req-1a2930de-2150-40b9-b73a-f76ddea50561 tempest-ServersTestJSON-774440597 tempest-ServersTestJSON-774440597-project-member] Enqueued Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_rules [ 723.151722] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_rules [ 723.152176] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341c1f60-30e8-4cc4-ae8a-741cd6542553 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.152176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.195590] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.195818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.195818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.196045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.196140] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.196315] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 already deleted. [ 723.196315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.196442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.196596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.196679] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.368231] env[62620]: INFO networking_nsxv3.common.synchronization [None req-792e60b7-2d05-4bf8-ba1f-e92ecdf55ea6 None None] Enqueued Resource ID: c44997a5-4b85-4e32-a913-0f15a4084d20 with Priority: HIGHEST for action port [ 723.368231] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c44997a5-4b85-4e32-a913-0f15a4084d20 with Priority: HIGHEST for action port [ 723.370025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-c44997a5-4b85-4e32-a913-0f15a4084d20 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.370025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c44997a5-4b85-4e32-a913-0f15a4084d20" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.370025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c44997a5-4b85-4e32-a913-0f15a4084d20" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.370236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c44997a5-4b85-4e32-a913-0f15a4084d20" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.370236] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c44997a5-4b85-4e32-a913-0f15a4084d20',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.474974] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.475319] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.475475] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.475802] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.476137] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.476348] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.476492] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.476743] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.476916] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.477174] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.478856] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.478856] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.478856] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.478856] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.478856] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.478856] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.509318] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.509534] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.509648] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.509834] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.510208] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-a7d230b4-8ae5-4c90-8ccf-806a4056e883 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.510416] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-a7d230b4-8ae5-4c90-8ccf-806a4056e883" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.510526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-a7d230b4-8ae5-4c90-8ccf-806a4056e883" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.512042] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-a7d230b4-8ae5-4c90-8ccf-806a4056e883" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.512042] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d230b4-8ae5-4c90-8ccf-806a4056e883',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.625349] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.716849] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.716988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.717181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.717404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.717463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.717557] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 already deleted. [ 723.717653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.878593] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c44997a5-4b85-4e32-a913-0f15a4084d20 [ 723.878593] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.878593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.878593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.878593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.878593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.878593] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c44997a5-4b85-4e32-a913-0f15a4084d20 already deleted. [ 723.879852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c44997a5-4b85-4e32-a913-0f15a4084d20" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.015999] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.016341] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.016449] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.016719] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.016949] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.017313] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port a7d230b4-8ae5-4c90-8ccf-806a4056e883 not found, creating... [ 724.017423] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.017705] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.017761] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.018047] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.018176] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.018475] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.018636] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.018787] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.019818] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.019986] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.020358] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: a7d230b4-8ae5-4c90-8ccf-806a4056e883 is going to be created. [ 724.041078] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.041078] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.041078] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.041078] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.041518] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.041967] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-a7d230b4-8ae5-4c90-8ccf-806a4056e883" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.131121] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.131121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.131121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.131121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.131121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.131121] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 is going to be created. [ 724.182688] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.182688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.182688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.182688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.182688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.193075] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: UNINITIALIZED for 2s [ 724.269029] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: SUCCESS [ 724.269029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.315464] env[62620]: INFO networking_nsxv3.common.synchronization [None req-3ba9a072-af9b-42b1-a660-dcee65ba3147 None None] Enqueued Resource ID: 2db999dd-0d35-4291-abf0-de8352994d52 with Priority: HIGHEST for action port [ 724.315747] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db999dd-0d35-4291-abf0-de8352994d52 with Priority: HIGHEST for action port [ 724.316864] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2db999dd-0d35-4291-abf0-de8352994d52 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.316968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2db999dd-0d35-4291-abf0-de8352994d52" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.318207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2db999dd-0d35-4291-abf0-de8352994d52" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.318492] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2db999dd-0d35-4291-abf0-de8352994d52" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.318588] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2db999dd-0d35-4291-abf0-de8352994d52',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.798756] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c496017c-beee-4fd7-8921-2f61e9ddb89b in Status: SUCCESS [ 724.799500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.799877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.799937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.800164] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.800302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.800381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.800619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.800706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.800795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.800885] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c496017c-beee-4fd7-8921-2f61e9ddb89b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.821944] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2db999dd-0d35-4291-abf0-de8352994d52 [ 724.822222] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.822429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.822429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.822722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.822887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.822887] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2db999dd-0d35-4291-abf0-de8352994d52 already deleted. [ 724.822989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2db999dd-0d35-4291-abf0-de8352994d52" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.307018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c496017c-beee-4fd7-8921-2f61e9ddb89b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.307018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.307018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.307018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.307018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.307018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.307700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.307700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.307700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.307700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.307700] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c496017c-beee-4fd7-8921-2f61e9ddb89b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.307700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.307931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.307931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.308073] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.308136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.308569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.308569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.308569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.308569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.308732] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c496017c-beee-4fd7-8921-2f61e9ddb89b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.475970] env[62620]: INFO networking_nsxv3.common.synchronization [req-69a0c14a-510b-417d-b71b-41bd6367b703 req-7756b11d-6dc6-4792-b2ea-0d04a46268be service nova] Enqueued Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_rules [ 725.476213] env[62620]: INFO networking_nsxv3.common.synchronization [req-69a0c14a-510b-417d-b71b-41bd6367b703 req-7756b11d-6dc6-4792-b2ea-0d04a46268be service nova] Enqueued Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 725.476354] env[62620]: INFO networking_nsxv3.common.synchronization [req-69a0c14a-510b-417d-b71b-41bd6367b703 req-7756b11d-6dc6-4792-b2ea-0d04a46268be service nova] Enqueued Resource ID: a7d230b4-8ae5-4c90-8ccf-806a4056e883 with Priority: HIGHEST for action port [ 725.476985] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_rules [ 725.477141] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 725.477796] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7d230b4-8ae5-4c90-8ccf-806a4056e883 with Priority: HIGHEST for action port [ 725.477796] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.477796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.477796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.477999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.478296] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.478941] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.479078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.479148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.479332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.479632] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.479741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.479857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.483601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.483601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.483601] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.483601] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7d230b4-8ae5-4c90-8ccf-806a4056e883 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.483601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7d230b4-8ae5-4c90-8ccf-806a4056e883" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.483601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7d230b4-8ae5-4c90-8ccf-806a4056e883" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.483601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7d230b4-8ae5-4c90-8ccf-806a4056e883" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.483601] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d230b4-8ae5-4c90-8ccf-806a4056e883',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.814118] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c496017c-beee-4fd7-8921-2f61e9ddb89b: rpc.has_security_group_logging(os_id): False [ 725.839179] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.839179] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.839179] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.839179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.839900] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.839900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.839900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.840188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.840341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.840671] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c496017c-beee-4fd7-8921-2f61e9ddb89b is going to be created. [ 725.895926] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.895926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.895926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.895926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.895926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.908959] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c496017c-beee-4fd7-8921-2f61e9ddb89b in Status: IN_PROGRESS for 2s [ 725.991298] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.991298] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.991298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.991298] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7d230b4-8ae5-4c90-8ccf-806a4056e883 with status ACTIVE [ 725.991298] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.991298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.991298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.991298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.991298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.991298] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.991298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.992503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.992849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.993993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.994343] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.994654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.995591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.995863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.005627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.005627] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7d230b4-8ae5-4c90-8ccf-806a4056e883 is going to be updated. [ 726.030436] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.030590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.030723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.031484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.031484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.031484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7d230b4-8ae5-4c90-8ccf-806a4056e883" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.210510] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: SUCCESS [ 726.210510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.210510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.210510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.210510] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.210510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.210510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.210510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.210510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.210510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.210510] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.490182] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.712777] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.712868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.713459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.713459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.713574] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.713740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.713843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.714012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.714195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.714195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.714355] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.714453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.714507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.714694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.715135] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.715135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.715135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.715135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.715295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.715295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.715349] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.991343] env[62620]: INFO networking_nsxv3.common.synchronization [req-aacaf878-b43b-40d9-b95b-45d7cca8f499 req-f281a544-66fb-44dc-8c96-c9c7d8bfe7dd tempest-ServersAdminTestJSON-158660873 tempest-ServersAdminTestJSON-158660873-project-member] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 726.992233] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 726.992544] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.992544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.992860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.993306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.993400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.993462] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b is going to be created. [ 726.994905] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.995135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.995213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.995558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.995903] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.996276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.996276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.996549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.996549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.996549] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.019271] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.019430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.019540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.020022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.020022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.030140] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: UNINITIALIZED for 2s [ 727.222680] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 202f6ed5-23fc-4a56-be57-1b3daf0aed84: rpc.has_security_group_logging(os_id): False [ 727.257410] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.257521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.257755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.257857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.257895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.258291] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.258291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.258291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.258502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.258502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.258653] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.261156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.261156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.261156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.261156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.261156] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.261156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.261156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.261156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.261156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.261156] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 is going to be created. [ 727.316577] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.316577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.316577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.316577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.316577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.330347] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: IN_PROGRESS for 2s [ 727.499631] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.499631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.499631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.500759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.500759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.500759] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.500759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.500759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.500759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.500759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.500759] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 already deleted. [ 727.500759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.839298] env[62620]: INFO networking_nsxv3.common.synchronization [None req-f61b08d1-886b-4659-baa9-330fb5584eee None None] Enqueued Resource ID: d9153684-3be0-458c-a209-fd10ca03131e with Priority: HIGHEST for action port [ 727.839298] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9153684-3be0-458c-a209-fd10ca03131e with Priority: HIGHEST for action port [ 727.839298] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9153684-3be0-458c-a209-fd10ca03131e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.839298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9153684-3be0-458c-a209-fd10ca03131e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.839298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9153684-3be0-458c-a209-fd10ca03131e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.839298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9153684-3be0-458c-a209-fd10ca03131e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.839298] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9153684-3be0-458c-a209-fd10ca03131e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.921340] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c496017c-beee-4fd7-8921-2f61e9ddb89b in Status: SUCCESS [ 727.921694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.965174] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-427 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.965394] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.965539] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.966165] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.966259] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.967428] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.967428] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.967428] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.967428] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.967565] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.967734] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.967788] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.967918] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.968078] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.968336] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.968504] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.987267] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.987376] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 727.987557] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.987701] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.988030] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-81a799c8-db8c-4bae-8609-d4bf5b56c600 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.988371] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-81a799c8-db8c-4bae-8609-d4bf5b56c600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.988371] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-81a799c8-db8c-4bae-8609-d4bf5b56c600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.988862] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-81a799c8-db8c-4bae-8609-d4bf5b56c600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.988862] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81a799c8-db8c-4bae-8609-d4bf5b56c600',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.340405] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9153684-3be0-458c-a209-fd10ca03131e [ 728.341233] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.341233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.341233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.341414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.341414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.341527] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9153684-3be0-458c-a209-fd10ca03131e already deleted. [ 728.341572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9153684-3be0-458c-a209-fd10ca03131e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.493459] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.493689] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.493824] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.494495] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.494495] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.494628] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 81a799c8-db8c-4bae-8609-d4bf5b56c600 not found, creating... [ 728.494902] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.495094] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.495212] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.495449] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.495595] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.495893] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.499598] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.499598] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.499598] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.499598] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.499598] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 81a799c8-db8c-4bae-8609-d4bf5b56c600 is going to be created. [ 728.525178] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.525628] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.525628] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.525811] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.526065] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.526303] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-81a799c8-db8c-4bae-8609-d4bf5b56c600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.894029] env[62620]: INFO networking_nsxv3.common.synchronization [None req-7e16b654-9f17-4da9-b6ee-adaddda4887d tempest-VolumesAdminNegativeTest-1197893955 tempest-VolumesAdminNegativeTest-1197893955-project-member] Enqueued Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_rules [ 728.894029] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_rules [ 728.894029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.894029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.894029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.894803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.895029] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.040105] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: SUCCESS [ 729.043741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.043741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.043741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.043741] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.043741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.043741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.043741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.043741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.043741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.043741] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.307986] env[62620]: INFO networking_nsxv3.common.synchronization [None req-9ff7c30b-44d5-4181-a36f-1d8857c81e5a tempest-VolumesAdminNegativeTest-1197893955 tempest-VolumesAdminNegativeTest-1197893955-project-member] Enqueued Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_rules [ 729.307986] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_rules [ 729.307986] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.307986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.341869] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: SUCCESS [ 729.342642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.418165] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.418484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.418484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.418977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.418977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.418977] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 already deleted. [ 729.418977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.419136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.419270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.419355] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.546018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.546018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.546018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.546018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.546018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.546018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.546018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.546649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.546649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.546649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.546649] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.546649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.546649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.546816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.546965] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.547057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.547121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.547263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.547337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.548083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.548083] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.940404] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.940757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.940858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.942176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.942176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.942176] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 already deleted. [ 729.942176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.054633] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16d45250-e90b-4ed6-befa-bdaacfced30b: rpc.has_security_group_logging(os_id): False [ 730.073679] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.073679] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.073679] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.073679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.074830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.075160] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.075644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.075808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.076072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.076241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.076535] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b is going to be created. [ 730.152029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.152029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.152029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.152029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.152029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.163660] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: IN_PROGRESS for 2s [ 730.353426] env[62620]: INFO networking_nsxv3.common.synchronization [req-3ad0588c-0d6d-4bff-be10-b325220b688a req-ab7f4c93-0c81-4f96-a880-5736994a3362 tempest-ServersAdminTestJSON-158660873 tempest-ServersAdminTestJSON-158660873-project-member] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 730.353989] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 730.354338] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.356060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.356857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.356857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.356857] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.357042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.357042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.357232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.357490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.357490] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.649082] env[62620]: INFO networking_nsxv3.common.synchronization [req-aacaf878-b43b-40d9-b95b-45d7cca8f499 req-d86d2876-7368-4b7a-8be8-5bbb88f792a2 service nova] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_rules [ 730.649396] env[62620]: INFO networking_nsxv3.common.synchronization [req-aacaf878-b43b-40d9-b95b-45d7cca8f499 req-d86d2876-7368-4b7a-8be8-5bbb88f792a2 service nova] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 730.649494] env[62620]: INFO networking_nsxv3.common.synchronization [req-aacaf878-b43b-40d9-b95b-45d7cca8f499 req-d86d2876-7368-4b7a-8be8-5bbb88f792a2 service nova] Enqueued Resource ID: 81a799c8-db8c-4bae-8609-d4bf5b56c600 with Priority: HIGHEST for action port [ 730.650373] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_rules [ 730.650373] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 730.650373] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a799c8-db8c-4bae-8609-d4bf5b56c600 with Priority: HIGHEST for action port [ 730.650720] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.650720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.650838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.651392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.651497] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.657447] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.657447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.657447] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-81a799c8-db8c-4bae-8609-d4bf5b56c600 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.657447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81a799c8-db8c-4bae-8609-d4bf5b56c600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.657447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81a799c8-db8c-4bae-8609-d4bf5b56c600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.657447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81a799c8-db8c-4bae-8609-d4bf5b56c600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.657447] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81a799c8-db8c-4bae-8609-d4bf5b56c600',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.861017] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.157985] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.158192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.162979] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81a799c8-db8c-4bae-8609-d4bf5b56c600 with status ACTIVE [ 731.162979] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.162979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.162979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.163289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.163385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.163592] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.163791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.163791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.163905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.164632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.165107] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.165107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.165107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.165327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.165417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.165527] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81a799c8-db8c-4bae-8609-d4bf5b56c600 is going to be updated. [ 731.184815] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.185405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.185405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.185405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.185683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.185683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81a799c8-db8c-4bae-8609-d4bf5b56c600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.364280] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.599190] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-427 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.599190] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.599190] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.599465] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.599919] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.602235] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.602235] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.602235] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.602235] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.602235] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.602235] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.602235] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.602235] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.602235] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.602235] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.602791] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.621564] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.621753] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 731.621881] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.622094] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.623062] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.623062] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.623062] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.623396] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.623396] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fee6b373-fb16-4c75-8b2d-d4df6e7e1952',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.868358] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.868649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.868649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.868891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.868994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.869109] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be created. [ 731.907913] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.908131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.908198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.908751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.908906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.925882] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: UNINITIALIZED for 2s [ 732.126479] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.126716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.128140] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.128140] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.128140] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.128140] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port fee6b373-fb16-4c75-8b2d-d4df6e7e1952 not found, creating... [ 732.128140] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.128140] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.128140] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.128526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.128526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.128753] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.128922] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.129712] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.130202] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.130515] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.131110] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: fee6b373-fb16-4c75-8b2d-d4df6e7e1952 is going to be created. [ 732.166191] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.166453] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.166589] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.166901] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.167154] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.168249] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.182213] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: SUCCESS [ 732.182435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.501093] env[62620]: INFO networking_nsxv3.common.synchronization [req-73c4cb24-3d0f-4784-a09d-75ead0c744ec req-7b1252f6-f9e9-4947-90a1-8b793477778b tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 732.501612] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 732.501886] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.502034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.502034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.504173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.504804] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.504804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.504804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.504804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.504804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.505021] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.923713] env[62620]: INFO networking_nsxv3.common.synchronization [None req-8e13e0e7-d7d5-4243-ac61-08d117ab977b None None] Enqueued Resource ID: b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7 with Priority: HIGHEST for action port [ 732.924054] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7 with Priority: HIGHEST for action port [ 732.924625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.924743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.924926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.931254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.931254] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.006840] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.007033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.007087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.007447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.007555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.008095] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.008360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.008442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.008610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.008844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.008844] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd already deleted. [ 733.008964] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.389153] env[62620]: INFO networking_nsxv3.common.synchronization [None req-68f8e813-1053-490d-b884-8f6ee308f0b0 None None] Enqueued Resource ID: 67d1c552-5ad4-4876-abf2-0b6e66680319 with Priority: HIGHEST for action port [ 733.390722] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67d1c552-5ad4-4876-abf2-0b6e66680319 with Priority: HIGHEST for action port [ 733.391073] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-67d1c552-5ad4-4876-abf2-0b6e66680319 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.391308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67d1c552-5ad4-4876-abf2-0b6e66680319" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.391363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67d1c552-5ad4-4876-abf2-0b6e66680319" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.391656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67d1c552-5ad4-4876-abf2-0b6e66680319" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.391729] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d1c552-5ad4-4876-abf2-0b6e66680319',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.433653] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7 [ 733.434140] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.434274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.434274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.434878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.434997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.435106] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7 already deleted. [ 733.435192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1654aa0-1a39-4c15-afbf-4dc1d63b8ab7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.634133] env[62620]: INFO networking_nsxv3.common.synchronization [None req-35c52e8d-310e-4b97-a735-cae0a91477f3 None None] Enqueued Resource ID: f48a5500-c9da-4b0e-b294-eac1f33fc67f with Priority: HIGHEST for action port [ 733.634437] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48a5500-c9da-4b0e-b294-eac1f33fc67f with Priority: HIGHEST for action port [ 733.635049] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-f48a5500-c9da-4b0e-b294-eac1f33fc67f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.635181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f48a5500-c9da-4b0e-b294-eac1f33fc67f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.635757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f48a5500-c9da-4b0e-b294-eac1f33fc67f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.636132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f48a5500-c9da-4b0e-b294-eac1f33fc67f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.636255] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f48a5500-c9da-4b0e-b294-eac1f33fc67f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.894066] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67d1c552-5ad4-4876-abf2-0b6e66680319 [ 733.894411] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.894612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.894676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.894949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.894949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.895198] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67d1c552-5ad4-4876-abf2-0b6e66680319 already deleted. [ 733.895198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67d1c552-5ad4-4876-abf2-0b6e66680319" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.938762] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 733.938762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.938762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.938762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.938762] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.938762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.938762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.938762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.938762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.938762] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.138953] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f48a5500-c9da-4b0e-b294-eac1f33fc67f [ 734.142553] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.142715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.142788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.143030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.143119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.143215] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f48a5500-c9da-4b0e-b294-eac1f33fc67f already deleted. [ 734.143294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f48a5500-c9da-4b0e-b294-eac1f33fc67f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.370642] env[62620]: INFO networking_nsxv3.common.synchronization [req-096fe3c8-8fc9-44cf-8029-4ac58f2116c8 req-9f151616-f5d7-4fc9-acee-3e0b0c34c39c tempest-DeleteServersAdminTestJSON-184387882 tempest-DeleteServersAdminTestJSON-184387882-project-admin] Enqueued Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 734.370642] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 734.370642] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.370642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.370642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.370642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.371030] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.371030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.371103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.371227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.371311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.371402] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.443795] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.461666] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.462569] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-988" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.462569] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-988" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.462569] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-988" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.465191] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.465191] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.465191] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.465191] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.465191] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.465191] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.465191] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.465643] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.465919] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.466041] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.467582] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.467582] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.487894] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.487894] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 734.488044] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.488283] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-988" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.488622] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-af7ffe26-3161-4ff9-abf9-eb8480443269 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.489313] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.489313] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.489313] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.491877] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af7ffe26-3161-4ff9-abf9-eb8480443269',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.497110] env[62620]: INFO networking_nsxv3.common.synchronization [req-3ad0588c-0d6d-4bff-be10-b325220b688a req-52dc5acd-78d4-4720-a277-af1c5f29bbca service nova] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_rules [ 734.497327] env[62620]: INFO networking_nsxv3.common.synchronization [req-3ad0588c-0d6d-4bff-be10-b325220b688a req-52dc5acd-78d4-4720-a277-af1c5f29bbca service nova] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 734.500011] env[62620]: INFO networking_nsxv3.common.synchronization [req-3ad0588c-0d6d-4bff-be10-b325220b688a req-52dc5acd-78d4-4720-a277-af1c5f29bbca service nova] Enqueued Resource ID: fee6b373-fb16-4c75-8b2d-d4df6e7e1952 with Priority: HIGHEST for action port [ 734.500011] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_rules [ 734.500011] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 734.500011] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fee6b373-fb16-4c75-8b2d-d4df6e7e1952 with Priority: HIGHEST for action port [ 734.500011] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.500011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.500011] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.500011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.500011] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.500011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.500011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.500011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.500011] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fee6b373-fb16-4c75-8b2d-d4df6e7e1952',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.823285] env[62620]: INFO networking_nsxv3.common.synchronization [None req-50fc03ad-97de-48c8-b0d7-8f301ea0ea71 None None] Enqueued Resource ID: 6ab1f2bd-119e-43fc-a40d-53f7438c0492 with Priority: HIGHEST for action port [ 734.823285] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab1f2bd-119e-43fc-a40d-53f7438c0492 with Priority: HIGHEST for action port [ 734.823285] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ab1f2bd-119e-43fc-a40d-53f7438c0492 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.823285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ab1f2bd-119e-43fc-a40d-53f7438c0492" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.823285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ab1f2bd-119e-43fc-a40d-53f7438c0492" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.823285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ab1f2bd-119e-43fc-a40d-53f7438c0492" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.823285] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab1f2bd-119e-43fc-a40d-53f7438c0492',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.873663] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.873933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.874047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.874293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.874432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.874596] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.874699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.874743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.874898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.874969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.875075] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 is going to be updated. [ 734.909288] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.909494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.909607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.912958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.912958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.923465] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: IN_PROGRESS for 2s [ 734.948078] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.999076] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.999267] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.999341] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.999606] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.999994] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.999994] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port af7ffe26-3161-4ff9-abf9-eb8480443269 not found, creating... [ 735.000303] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.000416] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.000493] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.000783] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.000869] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.002250] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.002250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.002250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.002250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.002250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.002250] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: af7ffe26-3161-4ff9-abf9-eb8480443269 is going to be created. [ 735.006080] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fee6b373-fb16-4c75-8b2d-d4df6e7e1952 with status ACTIVE [ 735.006228] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.006341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.006415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.006581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.006667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.006836] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.007168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.007168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.007168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.007415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.007415] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.007579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.007579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.008066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.008066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.008066] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fee6b373-fb16-4c75-8b2d-d4df6e7e1952 is going to be updated. [ 735.031431] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.032130] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.032130] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.032371] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.032595] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.032957] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.036197] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.036197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.036197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.036197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.036197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.036197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fee6b373-fb16-4c75-8b2d-d4df6e7e1952" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.326805] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ab1f2bd-119e-43fc-a40d-53f7438c0492 [ 735.326805] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.326805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.326805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.326805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.326805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.327021] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ab1f2bd-119e-43fc-a40d-53f7438c0492 already deleted. [ 735.327021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ab1f2bd-119e-43fc-a40d-53f7438c0492" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.455337] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.455337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.455337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.455337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.455337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.455337] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 735.482776] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.484141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.484401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.484639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.484932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.496076] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 735.883522] env[62620]: INFO networking_nsxv3.common.synchronization [None req-84b197ba-c05a-4210-810c-31299b3a255d None None] Enqueued Resource ID: eab4e5be-15ce-4a22-ae3b-c21fe74d68f9 with Priority: HIGHEST for action port [ 735.884656] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab4e5be-15ce-4a22-ae3b-c21fe74d68f9 with Priority: HIGHEST for action port [ 735.884656] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-eab4e5be-15ce-4a22-ae3b-c21fe74d68f9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.884656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eab4e5be-15ce-4a22-ae3b-c21fe74d68f9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.884656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eab4e5be-15ce-4a22-ae3b-c21fe74d68f9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.884962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eab4e5be-15ce-4a22-ae3b-c21fe74d68f9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.884997] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eab4e5be-15ce-4a22-ae3b-c21fe74d68f9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.013156] env[62620]: INFO networking_nsxv3.common.synchronization [req-73c4cb24-3d0f-4784-a09d-75ead0c744ec req-6de64e64-cc3c-4661-9c7a-812aede7bb67 service nova] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 736.017133] env[62620]: INFO networking_nsxv3.common.synchronization [req-73c4cb24-3d0f-4784-a09d-75ead0c744ec req-6de64e64-cc3c-4661-9c7a-812aede7bb67 service nova] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 736.017606] env[62620]: INFO networking_nsxv3.common.synchronization [req-73c4cb24-3d0f-4784-a09d-75ead0c744ec req-6de64e64-cc3c-4661-9c7a-812aede7bb67 service nova] Enqueued Resource ID: af7ffe26-3161-4ff9-abf9-eb8480443269 with Priority: HIGHEST for action port [ 736.018092] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 736.018171] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 736.018335] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af7ffe26-3161-4ff9-abf9-eb8480443269 with Priority: HIGHEST for action port [ 736.018537] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.020815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.020942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.021234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.021316] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.022226] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.022349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.022415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.022573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.022774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.022886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.022944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.023584] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.024512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.024512] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.024734] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-af7ffe26-3161-4ff9-abf9-eb8480443269 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.024936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.024936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.025078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.025157] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af7ffe26-3161-4ff9-abf9-eb8480443269',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.301262] env[62620]: INFO networking_nsxv3.common.synchronization [None req-54736cb8-e661-46c5-8a25-9c46f1ed43ae None None] Enqueued Resource ID: b01ecd0e-7eb7-4779-886d-9ed60d9fff3c with Priority: HIGHEST for action port [ 736.301451] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b01ecd0e-7eb7-4779-886d-9ed60d9fff3c with Priority: HIGHEST for action port [ 736.303619] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-b01ecd0e-7eb7-4779-886d-9ed60d9fff3c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.303619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b01ecd0e-7eb7-4779-886d-9ed60d9fff3c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.303619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b01ecd0e-7eb7-4779-886d-9ed60d9fff3c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.303619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b01ecd0e-7eb7-4779-886d-9ed60d9fff3c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.303619] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b01ecd0e-7eb7-4779-886d-9ed60d9fff3c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.389037] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eab4e5be-15ce-4a22-ae3b-c21fe74d68f9 [ 736.389299] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.389447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.389516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.389786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.389848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.389919] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eab4e5be-15ce-4a22-ae3b-c21fe74d68f9 already deleted. [ 736.390013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eab4e5be-15ce-4a22-ae3b-c21fe74d68f9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.528065] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.529405] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.529754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.530122] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af7ffe26-3161-4ff9-abf9-eb8480443269 with status ACTIVE [ 736.530122] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.530249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.531812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.531812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.531812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.531812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.531812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.531812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.531812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.531812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.531812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.532139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.532139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.532363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.532423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.532539] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af7ffe26-3161-4ff9-abf9-eb8480443269 is going to be updated. [ 736.554629] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.554883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.555103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.555679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.555843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.556222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.806197] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b01ecd0e-7eb7-4779-886d-9ed60d9fff3c [ 736.806197] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.806197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.806197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.806197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.806197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.806501] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b01ecd0e-7eb7-4779-886d-9ed60d9fff3c already deleted. [ 736.806501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b01ecd0e-7eb7-4779-886d-9ed60d9fff3c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.933667] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: SUCCESS [ 736.933879] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 deletion is rescheduled due to dependency. [ 736.934082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.037817] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.089431] env[62620]: INFO networking_nsxv3.common.synchronization [None req-85b21f24-e6d0-4736-ad59-97efa76bcb92 None None] Enqueued Resource ID: a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc with Priority: HIGHEST for action port [ 737.089667] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc with Priority: HIGHEST for action port [ 737.090198] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.090348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.090386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.090635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.092823] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.294896] env[62620]: INFO networking_nsxv3.common.synchronization [None req-ec71190c-c966-4d9a-9ef0-4d9ca586bd01 None None] Enqueued Resource ID: 49f14d76-ff24-442e-9651-9e320cb660ff with Priority: HIGHEST for action port [ 737.295168] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f14d76-ff24-442e-9651-9e320cb660ff with Priority: HIGHEST for action port [ 737.295725] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-49f14d76-ff24-442e-9651-9e320cb660ff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.297771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49f14d76-ff24-442e-9651-9e320cb660ff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.297771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49f14d76-ff24-442e-9651-9e320cb660ff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.297771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49f14d76-ff24-442e-9651-9e320cb660ff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.297771] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49f14d76-ff24-442e-9651-9e320cb660ff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.505607] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 737.505783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.505976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.506172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.506368] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.506485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.506550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.506705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.506788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.506902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.507035] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.507845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.508421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.509089] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.509181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.510022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.510022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.510022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.510022] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.542979] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.542979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.542979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.542979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.542979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.542979] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be created. [ 737.565224] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.565224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.565224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.565224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.565224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.574464] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: UNINITIALIZED for 2s [ 737.594925] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc [ 737.595247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.595385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.595451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.595685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.595771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.595865] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc already deleted. [ 737.595946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2f82cb8-e951-4ecf-a28f-8c5ae87f06fc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.803257] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49f14d76-ff24-442e-9651-9e320cb660ff [ 737.803257] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.803257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.803257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.803257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.803257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.803257] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49f14d76-ff24-442e-9651-9e320cb660ff already deleted. [ 737.803257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49f14d76-ff24-442e-9651-9e320cb660ff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.012300] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.012625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.012997] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.261158] env[62620]: INFO networking_nsxv3.common.synchronization [None req-c9824be3-a160-4c72-b074-761e33cacb44 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 738.261772] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 738.262054] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.262169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.262248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.262511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.262598] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.394836] env[62620]: INFO networking_nsxv3.common.synchronization [None req-6a892640-f811-4fb8-8401-43e691b0bd71 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 738.394836] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 738.395085] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.396332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.518013] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.784978] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.789194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.789194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.789194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.790543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.790543] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a already deleted. [ 738.790543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.790543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.790775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.790775] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.023033] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.023033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.023033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.023339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.023558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.023558] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 739.050188] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.050676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.050779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.051010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.051287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.059357] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 739.176395] env[62620]: INFO networking_nsxv3.common.synchronization [req-74cb0fea-2229-4922-899f-dc4c69d8107b req-c81339b7-fc16-4e5b-87d3-c66250a6cb03 tempest-VolumesAssistedSnapshotsTest-1178161758 tempest-VolumesAssistedSnapshotsTest-1178161758-project-member] Enqueued Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_members [ 739.176395] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_members [ 739.176780] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a6af52c-b1fd-4489-b26c-557260173089 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.177117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.177201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.178560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.178560] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.178560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.178560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.178560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.178560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.178560] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.314411] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.314411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.314411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.314411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.314411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.314411] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a already deleted. [ 739.314411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.585110] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 739.585465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.585663] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.585953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.586199] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.586359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.586439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.586621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.586725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.587498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.587565] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.685335] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.685335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.685335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.685335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.685335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.685335] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.685335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.685335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.685335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.685335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.685335] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a6af52c-b1fd-4489-b26c-557260173089 already deleted. [ 739.685335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.739577] env[62620]: INFO networking_nsxv3.common.synchronization [None req-204d97ad-04fb-4cc8-94e7-c8294b2ee0fa None None] Enqueued Resource ID: b76b8d34-d1a3-4a24-84ec-2828316a7f40 with Priority: HIGHEST for action port [ 739.739577] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b76b8d34-d1a3-4a24-84ec-2828316a7f40 with Priority: HIGHEST for action port [ 739.739577] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-b76b8d34-d1a3-4a24-84ec-2828316a7f40 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.739577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b76b8d34-d1a3-4a24-84ec-2828316a7f40" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.740689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b76b8d34-d1a3-4a24-84ec-2828316a7f40" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.743587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b76b8d34-d1a3-4a24-84ec-2828316a7f40" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.743587] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b76b8d34-d1a3-4a24-84ec-2828316a7f40',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.078120] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.078487] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-714" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.078707] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-714" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.079791] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-714" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.080149] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.080579] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.080713] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.080973] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.081173] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.081404] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.081522] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.081637] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.081767] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.081886] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.081998] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.082173] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.090276] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.090436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.090476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.090747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.090946] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.091073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.091173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.091863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.092024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.092133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.092369] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.092479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.092546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.092710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.092972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.094320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.094320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.095307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.095307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.095307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.095307] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.103046] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.103236] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.103418] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.103688] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-714" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.104671] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-32dda461-7395-4104-9323-4a39535875de taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.104929] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-32dda461-7395-4104-9323-4a39535875de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.105213] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-32dda461-7395-4104-9323-4a39535875de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.105576] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-32dda461-7395-4104-9323-4a39535875de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.105726] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32dda461-7395-4104-9323-4a39535875de',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.247296] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b76b8d34-d1a3-4a24-84ec-2828316a7f40 [ 740.247296] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.247465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.247465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.247836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.247836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.247960] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b76b8d34-d1a3-4a24-84ec-2828316a7f40 already deleted. [ 740.247960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b76b8d34-d1a3-4a24-84ec-2828316a7f40" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.335519] env[62620]: INFO networking_nsxv3.common.synchronization [req-eb814016-dead-4c7a-bc89-ac22a708eba5 req-14fe2092-3009-4105-a614-8c3aa708a533 tempest-ServerDiagnosticsNegativeTest-1603042516 tempest-ServerDiagnosticsNegativeTest-1603042516-project-member] Enqueued Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGHEST for action security_group_members [ 740.336870] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGHEST for action security_group_members [ 740.337390] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c496017c-beee-4fd7-8921-2f61e9ddb89b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.337829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.337829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.338935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.338935] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.338935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.338935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.339133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.339995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.339995] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c496017c-beee-4fd7-8921-2f61e9ddb89b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.598402] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daf462fc-bab6-4357-af22-b6d35dd411dd: rpc.has_security_group_logging(os_id): False [ 740.611555] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.611716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.611862] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.612201] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.612357] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.614193] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 32dda461-7395-4104-9323-4a39535875de not found, creating... [ 740.614292] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.614385] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.614506] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.614750] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.614982] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.616425] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.616630] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.616772] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.617052] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.617137] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.617270] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 32dda461-7395-4104-9323-4a39535875de is going to be created. [ 740.620531] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.620651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.622127] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.622127] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.622127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.622722] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.622722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.622722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.622722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.622722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.622722] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be created. [ 740.650647] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.650647] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.651826] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.651826] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.651971] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.655061] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-32dda461-7395-4104-9323-4a39535875de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.700508] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.700664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.700735] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.701013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.701220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.716428] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 740.842551] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.842712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.842968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.844161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.844161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.844161] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.844161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.844161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.844161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.844161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.844161] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c496017c-beee-4fd7-8921-2f61e9ddb89b is going to be updated. [ 740.880683] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.881195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.881195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.881195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.881420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.892448] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c496017c-beee-4fd7-8921-2f61e9ddb89b in Status: IN_PROGRESS for 2s [ 741.082296] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 741.082621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.084227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.084227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.084227] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.084227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.084227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.084227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.084227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.084227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.086379] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.087080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.087080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.087080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.087080] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.087394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.087637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.087904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.089045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.089045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.089045] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.591264] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b140e556-13f7-4e22-a7d6-53ddc3943100: rpc.has_security_group_logging(os_id): False [ 741.609684] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.610326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.612048] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.612048] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.612048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.612888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.613246] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.613737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.615683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.615683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.615683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.615683] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be created. [ 741.670643] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.670643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.670643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.670643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.670643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.683304] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 741.698597] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b1dd70ad-4300-4e04-b247-2720c220a358 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_rules [ 741.700018] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_rules [ 741.700018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.700018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.700313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.700575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.700802] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.823823] env[62620]: INFO networking_nsxv3.common.synchronization [req-74cb0fea-2229-4922-899f-dc4c69d8107b req-d62e59ba-aff2-414e-ad17-5fe1d8b96bb6 service nova] Enqueued Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_rules [ 741.823943] env[62620]: INFO networking_nsxv3.common.synchronization [req-74cb0fea-2229-4922-899f-dc4c69d8107b req-d62e59ba-aff2-414e-ad17-5fe1d8b96bb6 service nova] Enqueued Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_members [ 741.824585] env[62620]: INFO networking_nsxv3.common.synchronization [req-74cb0fea-2229-4922-899f-dc4c69d8107b req-d62e59ba-aff2-414e-ad17-5fe1d8b96bb6 service nova] Enqueued Resource ID: 32dda461-7395-4104-9323-4a39535875de with Priority: HIGHEST for action port [ 741.824585] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_rules [ 741.824585] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_members [ 741.824585] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32dda461-7395-4104-9323-4a39535875de with Priority: HIGHEST for action port [ 741.829817] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a6af52c-b1fd-4489-b26c-557260173089 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.829817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.829817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.829817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.829817] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.830982] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a6af52c-b1fd-4489-b26c-557260173089 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.830982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.831117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.831922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.831922] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.831922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.831922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.831922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.831922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.831922] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.832648] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-32dda461-7395-4104-9323-4a39535875de taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.832771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32dda461-7395-4104-9323-4a39535875de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.832829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32dda461-7395-4104-9323-4a39535875de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.832983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32dda461-7395-4104-9323-4a39535875de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.833064] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32dda461-7395-4104-9323-4a39535875de',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.914014] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d0109699-810f-4cde-a694-2ec2edafb697 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_rules [ 741.914671] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_rules [ 741.914855] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.914967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.222665] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.222665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.222665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.222665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.223020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.223052] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 already deleted. [ 742.223176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.223306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.223490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.223588] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.272488] env[62620]: INFO networking_nsxv3.common.synchronization [req-d2174986-6b02-4e71-b54e-db4b4098df8b req-694a4378-8675-41ad-9ec4-c966231ca287 tempest-MultipleCreateTestJSON-1897705394 tempest-MultipleCreateTestJSON-1897705394-project-member] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 742.273241] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 742.273745] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.276292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.276292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.279408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.279755] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.279755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.279879] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.279982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.280074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.280317] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.335287] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a6af52c-b1fd-4489-b26c-557260173089 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.335410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.335563] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32dda461-7395-4104-9323-4a39535875de with status ACTIVE [ 742.335736] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.335843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.335911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.336131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.336308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.336379] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.336470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.336532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.336678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.337304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.337484] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.337585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.337651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.337799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.337900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.338252] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32dda461-7395-4104-9323-4a39535875de is going to be updated. [ 742.339135] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.359885] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.359885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.359885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.360077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.360204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.360751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32dda461-7395-4104-9323-4a39535875de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.367335] env[62620]: INFO networking_nsxv3.common.synchronization [None req-6c92a843-252e-4d38-a008-82be128cc58a None None] Enqueued Resource ID: 1b365abd-1b96-451f-862c-6d9221e3d491 with Priority: HIGHEST for action port [ 742.367869] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b365abd-1b96-451f-862c-6d9221e3d491 with Priority: HIGHEST for action port [ 742.368404] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b365abd-1b96-451f-862c-6d9221e3d491 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.368524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b365abd-1b96-451f-862c-6d9221e3d491" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.368588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b365abd-1b96-451f-862c-6d9221e3d491" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.368845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b365abd-1b96-451f-862c-6d9221e3d491" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.368928] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b365abd-1b96-451f-862c-6d9221e3d491',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.729826] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 742.730378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.750035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.750181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.750278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.750446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.750537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.750631] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 already deleted. [ 742.750715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.785273] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.785696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.785864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.786389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.786389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.786389] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.786581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.786581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.786820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.786820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.786971] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 already deleted. [ 742.786971] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.843244] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.872753] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b365abd-1b96-451f-862c-6d9221e3d491 [ 742.873526] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.873768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.873768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.874620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.874620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.874620] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b365abd-1b96-451f-862c-6d9221e3d491 already deleted. [ 742.874620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b365abd-1b96-451f-862c-6d9221e3d491" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.903885] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c496017c-beee-4fd7-8921-2f61e9ddb89b in Status: SUCCESS [ 742.903885] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c496017c-beee-4fd7-8921-2f61e9ddb89b deletion is rescheduled due to dependency. [ 742.903885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.179164] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.179164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.179164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.179164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.179164] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.179164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.179164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.179164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.179164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.179164] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.179688] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.179855] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.180015] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.180170] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.180312] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.180471] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.203021] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.203208] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.203399] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.203539] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.203871] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-ef05a825-d4fa-406d-b515-9d2a22422ddc taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.204082] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-ef05a825-d4fa-406d-b515-9d2a22422ddc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.204214] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-ef05a825-d4fa-406d-b515-9d2a22422ddc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.204545] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-ef05a825-d4fa-406d-b515-9d2a22422ddc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.204693] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef05a825-d4fa-406d-b515-9d2a22422ddc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.349498] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.349498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.349498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.353093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.353093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.353093] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a6af52c-b1fd-4489-b26c-557260173089 is going to be created. [ 743.373458] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.373915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.373915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.374130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.375020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.383382] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a6af52c-b1fd-4489-b26c-557260173089 in Status: UNINITIALIZED for 2s [ 743.701474] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 743.701474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.702638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.702871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.702965] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.709991] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.710235] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.710366] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.710693] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.710836] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.712153] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port ef05a825-d4fa-406d-b515-9d2a22422ddc not found, creating... [ 743.712153] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.712401] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.712401] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.712721] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.712721] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.713126] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.713302] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.713428] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.713659] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.713804] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.713951] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: ef05a825-d4fa-406d-b515-9d2a22422ddc is going to be created. [ 743.736698] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.737575] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.737575] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.737679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.737829] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.738302] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-ef05a825-d4fa-406d-b515-9d2a22422ddc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.208856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.208856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.208856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.208856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.208856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.208856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.208856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.208856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.208856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.208856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.208856] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.255104] env[62620]: INFO networking_nsxv3.common.synchronization [req-d2174986-6b02-4e71-b54e-db4b4098df8b req-90f69e87-7a51-4e09-b915-f9a397fd9928 tempest-MultipleCreateTestJSON-1897705394 tempest-MultipleCreateTestJSON-1897705394-project-member] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 744.255941] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 744.256539] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.256539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.256539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.256691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.256773] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.256865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.256930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.260641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.260775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.260903] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.714034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.714225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.714289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.714551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.715522] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.715522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.715522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.715522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.715522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.715522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.715522] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.715522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.715522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.715522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.715975] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.715975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.715975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.715975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.716164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.716164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.716164] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.764176] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.764176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.764176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.764176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.764176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.764176] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.764176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.765890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.765890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.765890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.765890] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 already deleted. [ 744.765890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.978195] env[62620]: INFO networking_nsxv3.common.synchronization [req-d2174986-6b02-4e71-b54e-db4b4098df8b req-01de7e3d-053a-4f9e-904e-e39b458397c2 service nova] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_rules [ 744.978195] env[62620]: INFO networking_nsxv3.common.synchronization [req-d2174986-6b02-4e71-b54e-db4b4098df8b req-01de7e3d-053a-4f9e-904e-e39b458397c2 service nova] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 744.978195] env[62620]: INFO networking_nsxv3.common.synchronization [req-d2174986-6b02-4e71-b54e-db4b4098df8b req-01de7e3d-053a-4f9e-904e-e39b458397c2 service nova] Enqueued Resource ID: ef05a825-d4fa-406d-b515-9d2a22422ddc with Priority: HIGHEST for action port [ 744.978426] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_rules [ 744.978426] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 744.978821] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef05a825-d4fa-406d-b515-9d2a22422ddc with Priority: HIGHEST for action port [ 744.979373] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.981040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.981128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.981393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.981616] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.982903] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.983047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.983120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.983305] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.983462] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.983694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.983694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.983778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.983855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.983943] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.985749] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef05a825-d4fa-406d-b515-9d2a22422ddc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.985749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef05a825-d4fa-406d-b515-9d2a22422ddc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.985749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef05a825-d4fa-406d-b515-9d2a22422ddc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.985749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef05a825-d4fa-406d-b515-9d2a22422ddc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.985923] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef05a825-d4fa-406d-b515-9d2a22422ddc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.033594] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.036622] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.036622] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.037064] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.040789] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.040789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.040789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.040789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.040789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.040789] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.040789] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.040789] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.040789] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.040789] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.040789] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.040789] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.058872] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.059071] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.059236] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.059408] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.059715] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.059892] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.060033] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.061850] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.061850] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a68f6bb7-6d15-4329-aedf-cc72bcc3e57a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.221651] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b140e556-13f7-4e22-a7d6-53ddc3943100: rpc.has_security_group_logging(os_id): False [ 745.243074] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.243479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.243663] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.244701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.245223] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.245869] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.246191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.246365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.247979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.247979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.248127] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.248217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.248289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.248472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.248557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.248760] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.248854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.249047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.249106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.249156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.249206] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 745.311522] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.311626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.311816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.311956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.312247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.323265] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 745.405272] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a6af52c-b1fd-4489-b26c-557260173089 in Status: SUCCESS [ 745.405408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.405589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.405804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.406056] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.406209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.406314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.406443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.406527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.406615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.406709] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.489102] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef05a825-d4fa-406d-b515-9d2a22422ddc with status ACTIVE [ 745.489102] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.489399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.489399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.489520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.489611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.489806] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.489905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.489968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.490128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.490203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.491441] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.493891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.493891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.493891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.493891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.493891] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef05a825-d4fa-406d-b515-9d2a22422ddc is going to be updated. [ 745.495925] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.497705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.497705] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.515809] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.517355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.517355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.517355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.517355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.517355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef05a825-d4fa-406d-b515-9d2a22422ddc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.562707] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.563184] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.563184] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.563547] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.563614] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.563741] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port a68f6bb7-6d15-4329-aedf-cc72bcc3e57a not found, creating... [ 745.564109] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.564298] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.564422] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.564651] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.564795] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.566018] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.566135] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.566259] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.566467] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.566689] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.566757] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: a68f6bb7-6d15-4329-aedf-cc72bcc3e57a is going to be created. [ 745.586433] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.586644] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.586767] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.587073] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.587315] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.587541] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.912929] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.000713] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.416234] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a6af52c-b1fd-4489-b26c-557260173089: rpc.has_security_group_logging(os_id): False [ 746.435122] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.435122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.435122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.435122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.435122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.435122] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.435122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.435122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.435122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.435122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.435122] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a6af52c-b1fd-4489-b26c-557260173089 is going to be created. [ 746.489391] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.489391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.489391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.489391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.489391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.499635] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a6af52c-b1fd-4489-b26c-557260173089 in Status: IN_PROGRESS for 2s [ 746.506664] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.507112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.512394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.512394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.512394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.512394] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be created. [ 746.536035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.536035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.536035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.536035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.536035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.564134] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: UNINITIALIZED for 2s [ 747.167023] env[62620]: INFO networking_nsxv3.common.synchronization [req-a5851e95-facd-4c90-b3f2-44a013a04d70 req-86db2359-456a-4bba-805e-6205f46e936e tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 747.167391] env[62620]: INFO networking_nsxv3.common.synchronization [req-a5851e95-facd-4c90-b3f2-44a013a04d70 req-86db2359-456a-4bba-805e-6205f46e936e tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 747.167748] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 747.167828] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 747.168253] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.168343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.168452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.168598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.168783] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.168856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.168902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.169096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.169187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.169285] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.170565] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.170565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.170565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.170565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.170887] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.170887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.171056] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.171226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.171309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.171400] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.281439] env[62620]: INFO networking_nsxv3.common.synchronization [req-a5851e95-facd-4c90-b3f2-44a013a04d70 req-86db2359-456a-4bba-805e-6205f46e936e tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_rules [ 747.281439] env[62620]: INFO networking_nsxv3.common.synchronization [req-a5851e95-facd-4c90-b3f2-44a013a04d70 req-86db2359-456a-4bba-805e-6205f46e936e tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 747.281439] env[62620]: INFO networking_nsxv3.common.synchronization [req-a5851e95-facd-4c90-b3f2-44a013a04d70 req-86db2359-456a-4bba-805e-6205f46e936e tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 747.281439] env[62620]: INFO networking_nsxv3.common.synchronization [req-a5851e95-facd-4c90-b3f2-44a013a04d70 req-86db2359-456a-4bba-805e-6205f46e936e tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 747.281439] env[62620]: INFO networking_nsxv3.common.synchronization [req-a5851e95-facd-4c90-b3f2-44a013a04d70 req-86db2359-456a-4bba-805e-6205f46e936e tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: af7ffe26-3161-4ff9-abf9-eb8480443269 with Priority: HIGHEST for action port [ 747.281439] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_rules [ 747.281439] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 747.281725] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af7ffe26-3161-4ff9-abf9-eb8480443269 with Priority: HIGHEST for action port [ 747.281817] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 747.282068] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 747.282808] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.282808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.282808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.283210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.283424] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.285042] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.285182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.285565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.285565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.285565] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.287137] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-af7ffe26-3161-4ff9-abf9-eb8480443269 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.287137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.287137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.287137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.287137] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af7ffe26-3161-4ff9-abf9-eb8480443269',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.287507] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.287573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.287890] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.287890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.335270] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 747.336373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.586619] env[62620]: INFO networking_nsxv3.common.synchronization [req-d2174986-6b02-4e71-b54e-db4b4098df8b req-5fb8d436-e92f-4bcc-9b76-2030d5f3a153 service nova] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_rules [ 747.589400] env[62620]: INFO networking_nsxv3.common.synchronization [req-d2174986-6b02-4e71-b54e-db4b4098df8b req-5fb8d436-e92f-4bcc-9b76-2030d5f3a153 service nova] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 747.589726] env[62620]: INFO networking_nsxv3.common.synchronization [req-d2174986-6b02-4e71-b54e-db4b4098df8b req-5fb8d436-e92f-4bcc-9b76-2030d5f3a153 service nova] Enqueued Resource ID: a68f6bb7-6d15-4329-aedf-cc72bcc3e57a with Priority: HIGHEST for action port [ 747.590317] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_rules [ 747.590397] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 747.590443] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68f6bb7-6d15-4329-aedf-cc72bcc3e57a with Priority: HIGHEST for action port [ 747.592321] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.592470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.592753] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.592874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.593285] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.593858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.593912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.594744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.594973] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a68f6bb7-6d15-4329-aedf-cc72bcc3e57a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.673386] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.674412] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.790047] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.790313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.790686] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af7ffe26-3161-4ff9-abf9-eb8480443269 with status ACTIVE [ 747.790686] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.790899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.790899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.791697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.791697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.791763] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.792022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.792022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.792111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.792194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.792440] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.794299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.794299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.794299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.794299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.794299] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af7ffe26-3161-4ff9-abf9-eb8480443269 is going to be updated. [ 747.794822] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.794822] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.814646] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.814914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.815060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.817586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.817586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.817586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.016228] env[62620]: INFO networking_nsxv3.common.synchronization [None req-8c0d7eaf-8445-42d8-a5f5-97f2ea6985e3 None None] Enqueued Resource ID: 0d3e7b78-c2d6-47d6-8409-86695c974568 with Priority: HIGHEST for action port [ 748.016483] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d3e7b78-c2d6-47d6-8409-86695c974568 with Priority: HIGHEST for action port [ 748.016786] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d3e7b78-c2d6-47d6-8409-86695c974568 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.016912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d3e7b78-c2d6-47d6-8409-86695c974568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.016978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d3e7b78-c2d6-47d6-8409-86695c974568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.023610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d3e7b78-c2d6-47d6-8409-86695c974568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.023713] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d3e7b78-c2d6-47d6-8409-86695c974568',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.099484] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a68f6bb7-6d15-4329-aedf-cc72bcc3e57a with status ACTIVE [ 748.101019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.101019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.101019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.101019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.101019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.101019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.101019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.101019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.101019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.101019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.101019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.101572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.101572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.101572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.101572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.101689] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a68f6bb7-6d15-4329-aedf-cc72bcc3e57a is going to be updated. [ 748.123449] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.123620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.123723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.123984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.124159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.124382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a68f6bb7-6d15-4329-aedf-cc72bcc3e57a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.176434] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.177449] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.511069] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a6af52c-b1fd-4489-b26c-557260173089 in Status: SUCCESS [ 748.511205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.526920] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d3e7b78-c2d6-47d6-8409-86695c974568 [ 748.526920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.527251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.527251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.527339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.527404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.527537] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d3e7b78-c2d6-47d6-8409-86695c974568 already deleted. [ 748.527595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d3e7b78-c2d6-47d6-8409-86695c974568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.573570] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 748.573783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.574226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.574268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.574460] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.574573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.574644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.574793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.574876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.575067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.575067] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.577409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.577500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.577613] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.577721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.577785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.577950] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.578026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.578110] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.672936] env[62620]: INFO networking_nsxv3.common.synchronization [None req-e688cd4a-9b15-4b3f-b49c-4e822f4adeb3 None None] Enqueued Resource ID: ac23312f-9361-4e00-b24b-023e15ab7631 with Priority: HIGHEST for action port [ 748.673640] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac23312f-9361-4e00-b24b-023e15ab7631 with Priority: HIGHEST for action port [ 748.674046] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac23312f-9361-4e00-b24b-023e15ab7631 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.674375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac23312f-9361-4e00-b24b-023e15ab7631" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.674485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac23312f-9361-4e00-b24b-023e15ab7631" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.674961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac23312f-9361-4e00-b24b-023e15ab7631" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.675099] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac23312f-9361-4e00-b24b-023e15ab7631',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.683452] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.683598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.683708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.683952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.684049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.684149] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 748.685491] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.685560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.685614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.685837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.685837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.685909] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2320ca1-0555-4101-b523-0afb30ca04f0 is going to be created. [ 748.711734] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.711869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.711940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.712166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.712332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.715468] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.715653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.715724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.715949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.716104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.723366] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: UNINITIALIZED for 2s [ 748.724093] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 749.080321] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.080591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.080910] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.178276] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac23312f-9361-4e00-b24b-023e15ab7631 [ 749.178598] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.179332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.179332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.179608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.179608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.179723] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac23312f-9361-4e00-b24b-023e15ab7631 already deleted. [ 749.179847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac23312f-9361-4e00-b24b-023e15ab7631" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.274362] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 749.274542] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 749.274679] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGHEST for action security_group_members [ 749.275405] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 749.275587] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 749.275686] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGHEST for action security_group_members [ 749.275967] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.276420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.276420] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.276548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.276718] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.276718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.276839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.277034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.277178] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.277276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.278093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.278093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.278093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.278093] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.405905] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGHEST for action security_group_rules [ 749.405905] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGHEST for action security_group_members [ 749.405905] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_rules [ 749.405905] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 749.405905] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 749.405905] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 749.405905] env[62620]: INFO networking_nsxv3.common.synchronization [req-6bebe82d-0fc7-4735-ab1a-f81e11e4b927 req-026dbcb2-c877-4974-8600-faa923b72beb tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: af7ffe26-3161-4ff9-abf9-eb8480443269 with Priority: HIGHEST for action port [ 749.408477] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGHEST for action security_group_rules [ 749.408975] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_rules [ 749.411391] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 749.411391] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af7ffe26-3161-4ff9-abf9-eb8480443269 with Priority: HIGHEST for action port [ 749.411391] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 749.411391] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGHEST for action security_group_members [ 749.411391] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 749.412798] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.413856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.417553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.417553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.417553] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.419078] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.419183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.419497] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.419778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.420487] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-af7ffe26-3161-4ff9-abf9-eb8480443269 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.420722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.421692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.421750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.422599] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af7ffe26-3161-4ff9-abf9-eb8480443269',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.423313] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.423427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.423631] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.423687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.423968] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.424043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.584087] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.780754] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.873381] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b28af0e5-78e0-4790-b570-375bc2e76ccc None None] Enqueued Resource ID: d4b76cf9-e337-4235-8ca6-0c84dfc50a72 with Priority: HIGHEST for action port [ 749.874938] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4b76cf9-e337-4235-8ca6-0c84dfc50a72 with Priority: HIGHEST for action port [ 749.875404] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4b76cf9-e337-4235-8ca6-0c84dfc50a72 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.875404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4b76cf9-e337-4235-8ca6-0c84dfc50a72" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.875523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4b76cf9-e337-4235-8ca6-0c84dfc50a72" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.875743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4b76cf9-e337-4235-8ca6-0c84dfc50a72" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.875861] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4b76cf9-e337-4235-8ca6-0c84dfc50a72',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.921038] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.921038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.928525] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af7ffe26-3161-4ff9-abf9-eb8480443269 with status ACTIVE [ 749.928525] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.928525] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.928525] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.928525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.928525] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af7ffe26-3161-4ff9-abf9-eb8480443269 is going to be updated. [ 749.952817] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.952817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.952817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.952817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.952817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.952817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af7ffe26-3161-4ff9-abf9-eb8480443269" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.086764] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.088361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.088361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.088361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.088478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.089046] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 750.117543] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.117899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.117899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.118181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.118280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.128625] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 750.286382] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.380034] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4b76cf9-e337-4235-8ca6-0c84dfc50a72 [ 750.380286] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.380504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.380504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.380784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.380850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.380926] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4b76cf9-e337-4235-8ca6-0c84dfc50a72 already deleted. [ 750.381019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4b76cf9-e337-4235-8ca6-0c84dfc50a72" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.685919] env[62620]: INFO networking_nsxv3.common.synchronization [req-839f990e-eb21-4784-91f6-d6aa2db4cf30 req-effda063-a2c4-4e1e-834e-7eafd6193d11 tempest-ServersTestJSON-774440597 tempest-ServersTestJSON-774440597-project-member] Enqueued Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_members [ 750.685919] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_members [ 750.685919] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-341c1f60-30e8-4cc4-ae8a-741cd6542553 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.685919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.686303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.686615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.686787] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.686894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.686955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.687171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.687260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.687386] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.734814] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: SUCCESS [ 750.736827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.736827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.739707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.739707] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.739707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.739707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.739707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.739707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.739707] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.742307] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 750.748025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.748025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.748025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.748025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.748025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.748025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.748025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.748025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.748025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.782153] env[62620]: INFO networking_nsxv3.common.synchronization [None req-44367df9-c0af-48eb-93df-2fe309b6ce9d None None] Enqueued Resource ID: 4c7f4ccb-ff22-4efc-8566-927fdf356cba with Priority: HIGHEST for action port [ 750.785295] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7f4ccb-ff22-4efc-8566-927fdf356cba with Priority: HIGHEST for action port [ 750.786501] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7f4ccb-ff22-4efc-8566-927fdf356cba taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.786501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7f4ccb-ff22-4efc-8566-927fdf356cba" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.786501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7f4ccb-ff22-4efc-8566-927fdf356cba" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.786501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7f4ccb-ff22-4efc-8566-927fdf356cba" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.786501] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7f4ccb-ff22-4efc-8566-927fdf356cba',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.790832] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.790832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.791054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.791286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.791286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.791479] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 is going to be created. [ 750.817909] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.818154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.818154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.818750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.818750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.833197] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 in Status: UNINITIALIZED for 2s [ 751.191848] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.192040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.192182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.192366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.192467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.192675] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.192797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.192917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.193443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.193443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.193443] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 already deleted. [ 751.193443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.249670] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.250768] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.288814] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c7f4ccb-ff22-4efc-8566-927fdf356cba [ 751.289116] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.289290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.289372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.289614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.289712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.289809] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c7f4ccb-ff22-4efc-8566-927fdf356cba already deleted. [ 751.289918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7f4ccb-ff22-4efc-8566-927fdf356cba" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.594223] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.595397] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-690" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.595543] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-690" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.595950] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-690" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.596230] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.596407] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.598086] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.598086] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.598086] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.598086] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.598086] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.598086] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.598086] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.598086] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.598086] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.598483] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.624445] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.624855] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 751.625108] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.625331] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-690" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.625717] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.626422] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.626580] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.627778] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.627778] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abec21e1-204b-4ed0-801a-ab9f9bb8fcb9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.755390] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.758982] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.084388] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b503b6aa-5415-4426-878c-9080b0ac5326 None None] Enqueued Resource ID: e3545f24-37c1-4fe4-b85c-ca1fe15bef1e with Priority: HIGHEST for action port [ 752.084645] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3545f24-37c1-4fe4-b85c-ca1fe15bef1e with Priority: HIGHEST for action port [ 752.085407] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3545f24-37c1-4fe4-b85c-ca1fe15bef1e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.085585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3545f24-37c1-4fe4-b85c-ca1fe15bef1e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.085654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3545f24-37c1-4fe4-b85c-ca1fe15bef1e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.085975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3545f24-37c1-4fe4-b85c-ca1fe15bef1e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.086791] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3545f24-37c1-4fe4-b85c-ca1fe15bef1e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.131752] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.133580] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.133580] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.133580] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.133580] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.133580] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port abec21e1-204b-4ed0-801a-ab9f9bb8fcb9 not found, creating... [ 752.136724] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.136724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.136724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.136724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.136724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.136724] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.136724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.136724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.136724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.136724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.137171] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: abec21e1-204b-4ed0-801a-ab9f9bb8fcb9 is going to be created. [ 752.150508] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 752.150508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.150508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.150508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.150508] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.150508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.150934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.150934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.150934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.154290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.154290] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.154290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.154290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.154290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.154290] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.154290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.154290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.154290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.154290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.154290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.154290] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.157537] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.157537] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.157537] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.157537] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.157537] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.157537] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.261773] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.261773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.261773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.262066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.262066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.262301] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 752.264418] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.264418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.264418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.264418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.264418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.264418] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2320ca1-0555-4101-b523-0afb30ca04f0 is going to be updated. [ 752.313628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.313628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.313628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.313628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.313628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.313985] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.313985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.313985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.314105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.314242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.328452] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 752.330356] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: IN_PROGRESS for 2s [ 752.594724] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3545f24-37c1-4fe4-b85c-ca1fe15bef1e [ 752.594724] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.594724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.594724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.594724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.594724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.594724] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3545f24-37c1-4fe4-b85c-ca1fe15bef1e already deleted. [ 752.594724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3545f24-37c1-4fe4-b85c-ca1fe15bef1e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.658936] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32910d79-8601-44ca-ba8c-4e47ddc77063: rpc.has_security_group_logging(os_id): False [ 752.679862] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.680028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.680090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.680301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.680393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.680621] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.681847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.681847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.681847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.681847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.681847] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.681847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.681847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.681847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.681847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.681847] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.681847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.682341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.682434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.682545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.682825] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be created. [ 752.750634] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.750773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.750843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.751104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.751285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.765428] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 752.850026] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 in Status: SUCCESS [ 752.850282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.850478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.850760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.850985] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.851094] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.851157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.851308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.851385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.851478] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.899016] env[62620]: INFO networking_nsxv3.common.synchronization [None req-e4b81cf1-bf9a-4d32-9d61-0d3a56cc816f None None] Enqueued Resource ID: cd02660a-57f4-40e3-af0a-98c8170c9b25 with Priority: HIGHEST for action port [ 752.899518] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd02660a-57f4-40e3-af0a-98c8170c9b25 with Priority: HIGHEST for action port [ 752.899815] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd02660a-57f4-40e3-af0a-98c8170c9b25 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.899936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd02660a-57f4-40e3-af0a-98c8170c9b25" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.900023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd02660a-57f4-40e3-af0a-98c8170c9b25" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.901788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd02660a-57f4-40e3-af0a-98c8170c9b25" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.901867] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd02660a-57f4-40e3-af0a-98c8170c9b25',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.004798] env[62620]: INFO networking_nsxv3.common.synchronization [None req-bbccfa1f-12e5-47a5-bb66-4a0a55aebd4e None None] Enqueued Resource ID: fa4b6688-7c18-42c4-a3e2-2989bed04b29 with Priority: HIGHEST for action port [ 753.005070] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4b6688-7c18-42c4-a3e2-2989bed04b29 with Priority: HIGHEST for action port [ 753.005641] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa4b6688-7c18-42c4-a3e2-2989bed04b29 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.005878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa4b6688-7c18-42c4-a3e2-2989bed04b29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.005878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa4b6688-7c18-42c4-a3e2-2989bed04b29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.006105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa4b6688-7c18-42c4-a3e2-2989bed04b29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.006185] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa4b6688-7c18-42c4-a3e2-2989bed04b29',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.220842] env[62620]: INFO networking_nsxv3.common.synchronization [req-779b70f1-de1b-468b-9275-cb15bd514a90 req-06caaf1c-8bd9-4306-8713-f110dd7a3f04 tempest-ServersAdminNegativeTestJSON-337070548 tempest-ServersAdminNegativeTestJSON-337070548-project-member] Enqueued Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 753.224142] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 753.224142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.224142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.224142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.224142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.224142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.224142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.224142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.224142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.224142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.224142] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.225208] env[62620]: INFO networking_nsxv3.common.synchronization [None req-1c0fc3b5-6e69-40ed-b661-7d83260b63b2 None None] Enqueued Resource ID: ea95b425-852f-49f7-a7bc-fd22d8b3cb84 with Priority: HIGHEST for action port [ 753.225446] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea95b425-852f-49f7-a7bc-fd22d8b3cb84 with Priority: HIGHEST for action port [ 753.225917] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea95b425-852f-49f7-a7bc-fd22d8b3cb84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.226061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea95b425-852f-49f7-a7bc-fd22d8b3cb84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.226134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea95b425-852f-49f7-a7bc-fd22d8b3cb84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.226356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea95b425-852f-49f7-a7bc-fd22d8b3cb84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.226436] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea95b425-852f-49f7-a7bc-fd22d8b3cb84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.354733] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.405162] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd02660a-57f4-40e3-af0a-98c8170c9b25 [ 753.405162] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.405162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.405162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.405162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.405162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.405162] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd02660a-57f4-40e3-af0a-98c8170c9b25 already deleted. [ 753.405162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd02660a-57f4-40e3-af0a-98c8170c9b25" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.510599] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa4b6688-7c18-42c4-a3e2-2989bed04b29 [ 753.510876] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.511048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.511114] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.511314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.511402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.511487] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa4b6688-7c18-42c4-a3e2-2989bed04b29 already deleted. [ 753.511567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa4b6688-7c18-42c4-a3e2-2989bed04b29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.612452] env[62620]: INFO networking_nsxv3.common.synchronization [req-839f990e-eb21-4784-91f6-d6aa2db4cf30 req-4ad158f4-15ef-49ec-a584-84ab58489bfe service nova] Enqueued Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_rules [ 753.612621] env[62620]: INFO networking_nsxv3.common.synchronization [req-839f990e-eb21-4784-91f6-d6aa2db4cf30 req-4ad158f4-15ef-49ec-a584-84ab58489bfe service nova] Enqueued Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_members [ 753.612753] env[62620]: INFO networking_nsxv3.common.synchronization [req-839f990e-eb21-4784-91f6-d6aa2db4cf30 req-4ad158f4-15ef-49ec-a584-84ab58489bfe service nova] Enqueued Resource ID: abec21e1-204b-4ed0-801a-ab9f9bb8fcb9 with Priority: HIGHEST for action port [ 753.613014] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_rules [ 753.613151] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_members [ 753.613246] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abec21e1-204b-4ed0-801a-ab9f9bb8fcb9 with Priority: HIGHEST for action port [ 753.613812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341c1f60-30e8-4cc4-ae8a-741cd6542553 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.613931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.613996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.616881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.616881] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.621591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-341c1f60-30e8-4cc4-ae8a-741cd6542553 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.621591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.621591] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.621591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.621591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.621591] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abec21e1-204b-4ed0-801a-ab9f9bb8fcb9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.731615] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.731615] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea95b425-852f-49f7-a7bc-fd22d8b3cb84 [ 753.731615] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.731615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.731615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.731615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.731615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.731615] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea95b425-852f-49f7-a7bc-fd22d8b3cb84 already deleted. [ 753.731615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea95b425-852f-49f7-a7bc-fd22d8b3cb84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.856998] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.123828] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-341c1f60-30e8-4cc4-ae8a-741cd6542553 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.124160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.124383] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.126226] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abec21e1-204b-4ed0-801a-ab9f9bb8fcb9 with status ACTIVE [ 754.126226] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.126226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.126226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.126226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.126226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.126226] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.126226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.126226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.126670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.126670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.126670] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.126670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.126835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.126835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.127171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.127171] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abec21e1-204b-4ed0-801a-ab9f9bb8fcb9 is going to be updated. [ 754.150448] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.152316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.152430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.152808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.152912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.153069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abec21e1-204b-4ed0-801a-ab9f9bb8fcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.176167] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.176441] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.176594] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.176915] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.177234] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.177431] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.177830] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.178175] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.178425] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.178769] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.178927] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.179069] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.179820] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.179966] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.180096] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.180237] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.202248] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.202446] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.202602] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.202763] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.203292] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.203484] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.203606] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.203942] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.204565] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de87f0c-6ba0-47bb-8c42-aa150e7855fe',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.236023] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.340621] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 754.340757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.343442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.343442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.343442] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.343442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.343442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.343442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.343442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.343442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.343442] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.344505] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: SUCCESS [ 754.344702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.344862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.346295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.346295] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.346295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.346295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.346295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.346295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.346295] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.346696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.346696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.346874] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.346935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.346969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.347794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.347918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.348051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.348183] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.349303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.349589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.349628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.349734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.349799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.349942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.350028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.350115] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.362947] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.364251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.364251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.364251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.364251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.364483] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 is going to be updated. [ 754.393406] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.393617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.393719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.394206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.394287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.404667] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 in Status: IN_PROGRESS for 2s [ 754.631344] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.707066] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.708130] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.708130] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.708130] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.708130] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.712265] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 6de87f0c-6ba0-47bb-8c42-aa150e7855fe not found, creating... [ 754.713300] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.713300] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.713300] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.713300] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.713529] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.714432] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.714615] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.714754] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.714982] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.715183] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.715338] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 6de87f0c-6ba0-47bb-8c42-aa150e7855fe is going to be created. [ 754.736069] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.736295] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.736426] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.737289] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.737289] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.737289] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.738977] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.740552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.740552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.740552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.740552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.740552] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 is going to be updated. [ 754.772487] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.772487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.772487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.772865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.772865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.780470] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 754.780470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.780470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.780470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.780470] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.784544] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: IN_PROGRESS for 2s [ 754.850558] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.850807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.853801] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.854894] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.857028] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.138054] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.138229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.138300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.138518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.138647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.138698] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 is going to be created. [ 755.175546] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.175546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.175546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.175546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.175546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.187256] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 in Status: UNINITIALIZED for 2s [ 755.283644] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.283644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.283644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.283938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.284176] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.284228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.284288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.285194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.285194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.285194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.285194] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.358128] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2320ca1-0555-4101-b523-0afb30ca04f0: rpc.has_security_group_logging(os_id): False [ 755.361144] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.361144] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.377894] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.378193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.378193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.378432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.378432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.378994] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.378994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.378994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.378994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.379447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.379447] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2320ca1-0555-4101-b523-0afb30ca04f0 is going to be created. [ 755.430683] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.430845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.431324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.431324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.431409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.443886] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: IN_PROGRESS for 2s [ 755.571081] env[62620]: INFO networking_nsxv3.common.synchronization [req-779b70f1-de1b-468b-9275-cb15bd514a90 req-3aafc5f4-39e5-4ea7-a02d-fd2f39119d03 service nova] Enqueued Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_rules [ 755.571297] env[62620]: INFO networking_nsxv3.common.synchronization [req-779b70f1-de1b-468b-9275-cb15bd514a90 req-3aafc5f4-39e5-4ea7-a02d-fd2f39119d03 service nova] Enqueued Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 755.571459] env[62620]: INFO networking_nsxv3.common.synchronization [req-779b70f1-de1b-468b-9275-cb15bd514a90 req-3aafc5f4-39e5-4ea7-a02d-fd2f39119d03 service nova] Enqueued Resource ID: 6de87f0c-6ba0-47bb-8c42-aa150e7855fe with Priority: HIGHEST for action port [ 755.571701] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_rules [ 755.571831] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 755.571934] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de87f0c-6ba0-47bb-8c42-aa150e7855fe with Priority: HIGHEST for action port [ 755.577372] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.577372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.577372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.577372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.577372] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.577372] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.577372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.577372] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.577372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.577372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.577919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.577919] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de87f0c-6ba0-47bb-8c42-aa150e7855fe',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.770097] env[62620]: INFO networking_nsxv3.common.synchronization [None req-936d8c24-5670-4c7d-95d8-f08b48c73b7d None None] Enqueued Resource ID: 2d668e77-43b4-4767-8930-7e7aeea5b37c with Priority: HIGHEST for action port [ 755.771040] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d668e77-43b4-4767-8930-7e7aeea5b37c with Priority: HIGHEST for action port [ 755.773104] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d668e77-43b4-4767-8930-7e7aeea5b37c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.773104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d668e77-43b4-4767-8930-7e7aeea5b37c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.773104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d668e77-43b4-4767-8930-7e7aeea5b37c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.773104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d668e77-43b4-4767-8930-7e7aeea5b37c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.773104] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d668e77-43b4-4767-8930-7e7aeea5b37c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.788731] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.788731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.788731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.788731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.788731] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.789075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.789294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.789414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.789948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.790155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.790379] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.790500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.790570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.790737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.790939] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.791095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.791160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.791373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.791413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.791487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.791603] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.863542] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.867349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.867485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.868773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.868773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.868773] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2320ca1-0555-4101-b523-0afb30ca04f0 is going to be updated. [ 755.869625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.869754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.869987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.870701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.872128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.872128] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 755.898496] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.899313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.899313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.899313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.899313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.902035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.902454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.902667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.902972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.903343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.913727] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: IN_PROGRESS for 2s [ 755.915519] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 756.079980] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.080364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.081285] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6de87f0c-6ba0-47bb-8c42-aa150e7855fe with status ACTIVE [ 756.081629] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.081867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.082033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.082368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.082635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.082941] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.083406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.083757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.084104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.084444] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.085248] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.085572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.085732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.087602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.087602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.087602] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6de87f0c-6ba0-47bb-8c42-aa150e7855fe is going to be updated. [ 756.106096] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.106673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.107184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.107293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.107777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.107777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6de87f0c-6ba0-47bb-8c42-aa150e7855fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.277384] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d668e77-43b4-4767-8930-7e7aeea5b37c [ 756.277384] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.277548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.277548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.277848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.277848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.277999] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d668e77-43b4-4767-8930-7e7aeea5b37c already deleted. [ 756.278055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d668e77-43b4-4767-8930-7e7aeea5b37c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.295652] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32910d79-8601-44ca-ba8c-4e47ddc77063: rpc.has_security_group_logging(os_id): False [ 756.317057] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.321036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.321036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.321036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.321036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.322331] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.322482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.322558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.322766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.322852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.323667] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.323788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.323863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.324058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.324139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.324338] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.324423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.324506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.326990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.326990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.326990] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 756.384021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.384450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.384450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.384603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.384802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.397694] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 756.417083] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 in Status: SUCCESS [ 756.417412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.417604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.417823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.418104] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.418236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.418304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.418473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.418555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.418641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.418730] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.530254] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d40520f9-3652-4643-8e34-c7a24310b843 None None] Enqueued Resource ID: fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0 with Priority: HIGHEST for action port [ 756.530254] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0 with Priority: HIGHEST for action port [ 756.530254] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.530254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.530604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.530604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.530671] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.796727] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: SUCCESS [ 756.796727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.796727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.796727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.796727] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.796727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.796727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.796727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.796727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.796727] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.924075] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.033243] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0 [ 757.033467] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.033592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.033657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.038316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.038542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.038707] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0 already deleted. [ 757.039347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb1d9d2c-263c-4cc9-a149-d7d9bd2429a0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.199021] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 in Status: SUCCESS [ 757.199021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.199021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.199021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.199021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.199021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.199021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.199021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.199021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.199021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.199021] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.304636] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.428396] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89: rpc.has_security_group_logging(os_id): False [ 757.446416] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.446416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.446416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.446416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.446416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.446416] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.446808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.446808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.446808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.446934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.446977] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 is going to be created. [ 757.461272] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: SUCCESS [ 757.461840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.461840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.461930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.462029] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.499949] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.500132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.500205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.500417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.500588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.509783] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 in Status: IN_PROGRESS for 2s [ 757.702209] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.763671] env[62620]: INFO networking_nsxv3.common.synchronization [req-4cd83d4a-1049-4807-86b1-6d44625ca166 req-778910a4-ea38-4a69-a49f-d2b6c2df73d3 tempest-VolumesAdminNegativeTest-1197893955 tempest-VolumesAdminNegativeTest-1197893955-project-member] Enqueued Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_members [ 757.764346] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_members [ 757.764667] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.764795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.764888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.768588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.768588] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.768588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.768588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.768588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.768588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.768588] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.807603] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.927046] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: SUCCESS [ 757.927046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.927046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.927046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.927046] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.927046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.927046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.927046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.927046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.927046] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.929171] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 757.929466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.932037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.932037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.932037] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.932037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.932037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.932037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.932037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.932037] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.968696] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.968696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.206764] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 341c1f60-30e8-4cc4-ae8a-741cd6542553: rpc.has_security_group_logging(os_id): False [ 758.225257] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.225609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.225609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.225842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.225842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.226061] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.226167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.226218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.226410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.226484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.226567] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 is going to be created. [ 758.272317] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.272317] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.272317] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.272317] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.272317] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.273456] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.273456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.273456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.273456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.273456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.273456] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 already deleted. [ 758.273456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.281839] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.281839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.281839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.281839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.281839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.295761] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 in Status: IN_PROGRESS for 2s [ 758.310465] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.310612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.310687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.311705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.311908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.312074] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 is going to be updated. [ 758.355802] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.356060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.356398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.356503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.356722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.365277] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: IN_PROGRESS for 2s [ 758.410546] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 758.410546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.433360] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.435372] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.572863] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-387 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.573521] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-387" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.574098] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-387" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.574645] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-387" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.575162] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.575548] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.575825] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.576276] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.576697] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.577725] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 758.577951] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.578237] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.578524] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.578763] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 758.578975] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.579249] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.599975] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.601029] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 758.601609] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.604660] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-387" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.605187] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.605433] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.605574] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.605949] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.606182] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.936591] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.942570] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.109123] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.109419] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.109553] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.109837] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.109987] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.110178] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991 not found, creating... [ 759.110472] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.110636] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.110756] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.110991] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.111543] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.111543] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.111687] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.111722] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.114586] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.114586] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.114586] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991 is going to be created. [ 759.131812] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.132038] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.132168] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.132458] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.132672] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.132901] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.443034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.444154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.444154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.444154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.444328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.444426] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2320ca1-0555-4101-b523-0afb30ca04f0 is going to be updated. [ 759.447128] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.447852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.447852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.447852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.447852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.447852] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 759.479201] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.479391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.479467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.479757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.479937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.481918] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.482049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.482119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.486469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.486469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.497126] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: IN_PROGRESS for 2s [ 759.497987] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 759.520274] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 in Status: SUCCESS [ 759.520587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.293202] env[62620]: INFO networking_nsxv3.common.synchronization [None req-fae72c15-82b4-4cf4-be55-71cab3ccec90 None None] Enqueued Resource ID: 2c1606cb-48ee-49d9-9f06-4ee876ce18d1 with Priority: HIGHEST for action port [ 760.293465] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c1606cb-48ee-49d9-9f06-4ee876ce18d1 with Priority: HIGHEST for action port [ 760.294375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c1606cb-48ee-49d9-9f06-4ee876ce18d1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.294502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c1606cb-48ee-49d9-9f06-4ee876ce18d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.294621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c1606cb-48ee-49d9-9f06-4ee876ce18d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.295077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c1606cb-48ee-49d9-9f06-4ee876ce18d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.295171] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c1606cb-48ee-49d9-9f06-4ee876ce18d1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.306750] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 in Status: SUCCESS [ 760.306953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.360753] env[62620]: INFO networking_nsxv3.common.synchronization [req-4cd83d4a-1049-4807-86b1-6d44625ca166 req-0b1cbd82-883d-4997-bfa4-72405b3e9bbd service nova] Enqueued Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_rules [ 760.361037] env[62620]: INFO networking_nsxv3.common.synchronization [req-4cd83d4a-1049-4807-86b1-6d44625ca166 req-0b1cbd82-883d-4997-bfa4-72405b3e9bbd service nova] Enqueued Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_members [ 760.361259] env[62620]: INFO networking_nsxv3.common.synchronization [req-4cd83d4a-1049-4807-86b1-6d44625ca166 req-0b1cbd82-883d-4997-bfa4-72405b3e9bbd service nova] Enqueued Resource ID: e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991 with Priority: HIGHEST for action port [ 760.361842] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_rules [ 760.362010] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_members [ 760.362121] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991 with Priority: HIGHEST for action port [ 760.362484] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.362913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.362913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.363142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.363142] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.363982] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.364152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.364225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.364402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.364557] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.364654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.364707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.364848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.364944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.365687] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.367877] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.367877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.367877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.367877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.368117] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.382229] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: SUCCESS [ 760.382364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.382906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.383160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.383455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.383455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.383639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.383695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.383745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.383858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.383965] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.797323] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c1606cb-48ee-49d9-9f06-4ee876ce18d1 [ 760.797669] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.797761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.797827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.798029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.798113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.798207] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c1606cb-48ee-49d9-9f06-4ee876ce18d1 already deleted. [ 760.798289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c1606cb-48ee-49d9-9f06-4ee876ce18d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.870829] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.870829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.871215] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991 with status ACTIVE [ 760.871488] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.871628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.871710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.872649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.872761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.873023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.873617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.873617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.873617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.873617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.874066] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.874066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.874066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.874066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.874369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.874369] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991 is going to be updated. [ 760.875701] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.885765] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.885996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.886074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.886274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.886920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.886920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.886920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.886920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.886920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.887222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.892340] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.892474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.892562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.892747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.894455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.894455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.894455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.894455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.894455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.894455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.894455] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.895745] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.895894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.895942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.896105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.898366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.898366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e56ec5b3-09ba-4f3a-9238-ed7d6c1f7991" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.380392] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.398589] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217: rpc.has_security_group_logging(os_id): False [ 761.418234] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.418234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.418234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.418234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.418234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.418424] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.418468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.419532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.419532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.419532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.419532] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.419532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.419532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.419532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.419532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.420853] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.420853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.420853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.420853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.420853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.420853] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 is going to be updated. [ 761.485547] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.485547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.485547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.485547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.485547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.499031] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: IN_PROGRESS for 2s [ 761.507902] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.507902] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.507902] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.507902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.507902] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.510068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.510068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.510068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.510068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.510068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.510068] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.512086] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: SUCCESS [ 761.512319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.512467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.512655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.512927] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.512927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.513106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.513282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.513282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.513380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.513451] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.881837] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.882234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.882234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.882306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.882402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.882505] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 is going to be created. [ 761.919425] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.919584] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.919678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.919897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.920026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.929076] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 in Status: UNINITIALIZED for 2s [ 762.019578] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.019725] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daf462fc-bab6-4357-af22-b6d35dd411dd: rpc.has_security_group_logging(os_id): False [ 762.039857] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.040042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.040119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.040359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.040458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.040790] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.040790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.040930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.041052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.041150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.041366] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.041462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.041522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.042642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.042642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.042642] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.042642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.042642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.042820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.042858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.043103] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 762.101991] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.102267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.102267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.102496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.102657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.117156] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 762.523111] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2320ca1-0555-4101-b523-0afb30ca04f0: rpc.has_security_group_logging(os_id): False [ 762.545539] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.545539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.545539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.545539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.545539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.545539] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.545539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.545539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.545539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.546147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.546147] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2320ca1-0555-4101-b523-0afb30ca04f0 is going to be updated. [ 762.549938] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d0446318-18a9-4fba-9a50-4443890cddf4 None None] Enqueued Resource ID: 256e5343-4304-4ef4-867b-60170bc44a4d with Priority: HIGHEST for action port [ 762.550243] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e5343-4304-4ef4-867b-60170bc44a4d with Priority: HIGHEST for action port [ 762.550347] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-256e5343-4304-4ef4-867b-60170bc44a4d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.550466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-256e5343-4304-4ef4-867b-60170bc44a4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.550535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-256e5343-4304-4ef4-867b-60170bc44a4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.551286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-256e5343-4304-4ef4-867b-60170bc44a4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.551286] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('256e5343-4304-4ef4-867b-60170bc44a4d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.601990] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.601990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.601990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.601990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.601990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.622842] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: IN_PROGRESS for 2s [ 763.053399] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 256e5343-4304-4ef4-867b-60170bc44a4d [ 763.053683] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.054486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.054486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.054486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.054486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.054486] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:256e5343-4304-4ef4-867b-60170bc44a4d already deleted. [ 763.054486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-256e5343-4304-4ef4-867b-60170bc44a4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.513615] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: SUCCESS [ 763.515506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.941433] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 in Status: SUCCESS [ 763.941756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.941871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.942166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.942386] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.942506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.942566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.942734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.942830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.942915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.943489] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.129397] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 764.129708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.129797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.130103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.130297] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.446524] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.635022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.635022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.635022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.635022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.635022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.635022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.635022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.635022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.635022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.635022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.635022] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.638254] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: SUCCESS [ 764.638254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.949348] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a74e416-c2f5-41f6-a7d3-a2cd9c682858: rpc.has_security_group_logging(os_id): False [ 764.972869] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.972869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.972869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.972869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.972869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.972869] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.972869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.972869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.972869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.972869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.972869] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 is going to be created. [ 765.033880] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.033880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.033880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.033880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.033880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.050141] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 in Status: IN_PROGRESS for 2s [ 765.139092] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.139444] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.139444] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.139585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.139761] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.139866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.139929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.140105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.141306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.141306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.141306] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.141306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.141306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.141306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.141306] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.141306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.141306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.141306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.141772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.141772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.141772] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.647424] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daf462fc-bab6-4357-af22-b6d35dd411dd: rpc.has_security_group_logging(os_id): False [ 765.666734] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.667567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.670010] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.670010] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.670010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.670010] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.670568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.670568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.670568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.670568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.670568] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 765.734028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.734028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.734028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.734028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.734028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.747870] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 766.073962] env[62620]: INFO networking_nsxv3.common.synchronization [req-cc037c67-a9dd-4b70-b0b1-35065e686b5a req-e46cc352-e536-45ac-adeb-79af8bd9a739 tempest-ServersTestBootFromVolume-172209119 tempest-ServersTestBootFromVolume-172209119-project-member] Enqueued Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_members [ 766.073962] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_members [ 766.074301] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa37dde5-b59c-4c95-8712-27727dd6ae4e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.074431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.074499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.074750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.074902] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.074998] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.076110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.076292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.076395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.076545] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.324041] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b98ab248-6446-406d-8602-4c5dc4f58714 None None] Enqueued Resource ID: 548e962e-f39e-465d-be1f-05fda4fc4958 with Priority: HIGHEST for action port [ 766.329045] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 548e962e-f39e-465d-be1f-05fda4fc4958 with Priority: HIGHEST for action port [ 766.329045] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-548e962e-f39e-465d-be1f-05fda4fc4958 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.329045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-548e962e-f39e-465d-be1f-05fda4fc4958" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.329045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-548e962e-f39e-465d-be1f-05fda4fc4958" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.329045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-548e962e-f39e-465d-be1f-05fda4fc4958" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.329045] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('548e962e-f39e-465d-be1f-05fda4fc4958',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.584755] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.584921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.584973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.585210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.585311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.585539] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.585650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.585701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.585847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.585923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.586023] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e already deleted. [ 766.586108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.831293] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 548e962e-f39e-465d-be1f-05fda4fc4958 [ 766.831293] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.831293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.831293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.831293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.831293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.831293] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:548e962e-f39e-465d-be1f-05fda4fc4958 already deleted. [ 766.831293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-548e962e-f39e-465d-be1f-05fda4fc4958" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.066095] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 in Status: SUCCESS [ 767.066359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.084604] env[62620]: INFO networking_nsxv3.common.synchronization [req-9238b777-b0d4-44d3-9d4b-954d997d6046 req-74647104-90b5-42db-a410-8cf1ef6d419e tempest-MultipleCreateTestJSON-1897705394 tempest-MultipleCreateTestJSON-1897705394-project-member] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 767.085228] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 767.085579] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.085705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.085773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.085986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.086239] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.086376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.086449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.086642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.086754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.086875] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.590245] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.762825] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 767.763145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.098317] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.158552] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.158752] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-795" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.158876] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-795" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.159256] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-795" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.160269] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.160269] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.160269] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.160269] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.160269] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.160580] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.160580] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.160648] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.160694] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.160799] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.160917] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.161461] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.177746] env[62620]: INFO networking_nsxv3.common.synchronization [req-ac68c546-e40c-4953-9e5d-64eade1881d6 req-88803a50-bc45-4d40-9029-af3203e5ae02 tempest-MultipleCreateTestJSON-1897705394 tempest-MultipleCreateTestJSON-1897705394-project-member] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 768.177746] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 768.177746] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.177746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.179857] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.180028] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.180167] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.181146] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-795" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.181146] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-87592606-744f-4632-a44b-69f4b8ef9acf taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.181146] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-87592606-744f-4632-a44b-69f4b8ef9acf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.181146] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-87592606-744f-4632-a44b-69f4b8ef9acf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.181485] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-87592606-744f-4632-a44b-69f4b8ef9acf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.181485] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87592606-744f-4632-a44b-69f4b8ef9acf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.546609] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-3c94c723-fe86-421f-8176-cc25c0a41747 tempest-ListServersNegativeTestJSON-1492694773 tempest-ListServersNegativeTestJSON-1492694773-project-member] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 768.546609] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 768.546609] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.549344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.549489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.549681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.549887] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.550067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.550067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.550067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.550067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.550916] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.600686] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.600686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.600686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.601088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.601088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.601153] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 768.622639] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d689e242-9955-4b52-a22f-51a8aa05ee4c None None] Enqueued Resource ID: 2a5cd933-13c1-4f5a-976b-507b896cc9d4 with Priority: HIGHEST for action port [ 768.622639] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a5cd933-13c1-4f5a-976b-507b896cc9d4 with Priority: HIGHEST for action port [ 768.622639] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a5cd933-13c1-4f5a-976b-507b896cc9d4 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.623258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a5cd933-13c1-4f5a-976b-507b896cc9d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.623471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a5cd933-13c1-4f5a-976b-507b896cc9d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.624167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a5cd933-13c1-4f5a-976b-507b896cc9d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.625317] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a5cd933-13c1-4f5a-976b-507b896cc9d4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.643156] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.643156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.643156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.643156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.643156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.652543] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 768.686591] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.687196] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.687513] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.687861] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.688047] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.688215] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 87592606-744f-4632-a44b-69f4b8ef9acf not found, creating... [ 768.688655] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.688655] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.688792] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.688996] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.689149] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.689461] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.689623] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.689834] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.690369] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.690369] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.690369] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 87592606-744f-4632-a44b-69f4b8ef9acf is going to be created. [ 768.724706] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.724925] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.725082] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.725434] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.725664] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.725917] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-87592606-744f-4632-a44b-69f4b8ef9acf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.816028] env[62620]: INFO networking_nsxv3.common.synchronization [None req-2c3aa20c-9c97-477e-a951-641eeee25439 None None] Enqueued Resource ID: 79f350ba-5be5-47ca-9e06-ea6924907fa5 with Priority: HIGHEST for action port [ 768.816028] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79f350ba-5be5-47ca-9e06-ea6924907fa5 with Priority: HIGHEST for action port [ 768.816028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-79f350ba-5be5-47ca-9e06-ea6924907fa5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.816028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79f350ba-5be5-47ca-9e06-ea6924907fa5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.816028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79f350ba-5be5-47ca-9e06-ea6924907fa5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.817141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79f350ba-5be5-47ca-9e06-ea6924907fa5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.817350] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f350ba-5be5-47ca-9e06-ea6924907fa5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.052955] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.053106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.053175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.054200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.054200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.054200] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.054200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.054200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.054200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.054200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.054200] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff already deleted. [ 769.054200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.127652] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a5cd933-13c1-4f5a-976b-507b896cc9d4 [ 769.127892] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.129540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.129717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.129856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.129950] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.130070] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a5cd933-13c1-4f5a-976b-507b896cc9d4 already deleted. [ 769.130182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a5cd933-13c1-4f5a-976b-507b896cc9d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.320945] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79f350ba-5be5-47ca-9e06-ea6924907fa5 [ 769.321252] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.321418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.321482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.321704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.321806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.321904] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79f350ba-5be5-47ca-9e06-ea6924907fa5 already deleted. [ 769.321986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79f350ba-5be5-47ca-9e06-ea6924907fa5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.503995] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.503995] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.503995] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.503995] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.503995] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.503995] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.504433] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.504772] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.505063] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.505514] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.505775] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.505994] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.506330] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.506552] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.506851] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.507105] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.527152] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.527152] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 769.527152] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.527152] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.527152] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-0f9d4335-0759-496e-8e45-fec3775be050 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.527152] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-0f9d4335-0759-496e-8e45-fec3775be050" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.527152] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-0f9d4335-0759-496e-8e45-fec3775be050" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.527152] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-0f9d4335-0759-496e-8e45-fec3775be050" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.527152] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9d4335-0759-496e-8e45-fec3775be050',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.861493] env[62620]: INFO networking_nsxv3.common.synchronization [req-cc037c67-a9dd-4b70-b0b1-35065e686b5a req-83c7ef3f-d4ad-40aa-995b-5f2574aee8f0 service nova] Enqueued Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_rules [ 769.861493] env[62620]: INFO networking_nsxv3.common.synchronization [req-cc037c67-a9dd-4b70-b0b1-35065e686b5a req-83c7ef3f-d4ad-40aa-995b-5f2574aee8f0 service nova] Enqueued Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_members [ 769.861493] env[62620]: INFO networking_nsxv3.common.synchronization [req-cc037c67-a9dd-4b70-b0b1-35065e686b5a req-83c7ef3f-d4ad-40aa-995b-5f2574aee8f0 service nova] Enqueued Resource ID: 87592606-744f-4632-a44b-69f4b8ef9acf with Priority: HIGHEST for action port [ 769.861909] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_rules [ 769.861909] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_members [ 769.861909] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87592606-744f-4632-a44b-69f4b8ef9acf with Priority: HIGHEST for action port [ 769.862437] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.863346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.863346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.863346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.863346] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.869814] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa37dde5-b59c-4c95-8712-27727dd6ae4e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.869814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.869814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.869814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.869814] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.869814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.869814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.870400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.870400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.870400] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.874717] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-87592606-744f-4632-a44b-69f4b8ef9acf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.874717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87592606-744f-4632-a44b-69f4b8ef9acf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.874717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87592606-744f-4632-a44b-69f4b8ef9acf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.874717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87592606-744f-4632-a44b-69f4b8ef9acf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.874717] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87592606-744f-4632-a44b-69f4b8ef9acf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.034902] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.034902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.034902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.034902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.034902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.034902] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 0f9d4335-0759-496e-8e45-fec3775be050 not found, creating... [ 770.034902] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.034902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.034902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.034902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.034902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.035518] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.035518] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.035518] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.035518] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.037023] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.037023] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 0f9d4335-0759-496e-8e45-fec3775be050 is going to be created. [ 770.054996] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.055225] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.055356] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.055676] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.055904] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.056388] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-0f9d4335-0759-496e-8e45-fec3775be050" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.295289] env[62620]: INFO networking_nsxv3.common.synchronization [None req-df5c5bcd-97bf-4452-9f3c-2eadac52184d tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_rules [ 770.295770] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_rules [ 770.296086] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.296213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.296282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.296527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.296609] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.325188] env[62620]: INFO networking_nsxv3.common.synchronization [None req-df510ccb-480c-4760-a93d-4dde9ed94772 None None] Enqueued Resource ID: 5abe3f6a-ae52-49b5-b42b-cb28985f918d with Priority: HIGHEST for action port [ 770.325188] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5abe3f6a-ae52-49b5-b42b-cb28985f918d with Priority: HIGHEST for action port [ 770.325188] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-5abe3f6a-ae52-49b5-b42b-cb28985f918d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.325188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5abe3f6a-ae52-49b5-b42b-cb28985f918d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.325188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5abe3f6a-ae52-49b5-b42b-cb28985f918d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.325816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5abe3f6a-ae52-49b5-b42b-cb28985f918d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.326078] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5abe3f6a-ae52-49b5-b42b-cb28985f918d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.374144] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.379268] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa37dde5-b59c-4c95-8712-27727dd6ae4e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.379268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.379268] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87592606-744f-4632-a44b-69f4b8ef9acf with status ACTIVE [ 770.379268] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.379268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.379268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.379268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.379268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.379268] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.379268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.379268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.379268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.379268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.379268] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.379928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.379928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.380408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.380628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.380800] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87592606-744f-4632-a44b-69f4b8ef9acf is going to be updated. [ 770.402422] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.402573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.402645] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.402856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.402998] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.403355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87592606-744f-4632-a44b-69f4b8ef9acf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.473918] env[62620]: INFO networking_nsxv3.common.synchronization [None req-8fa685a6-a223-40eb-bc81-d8565f64a510 tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_rules [ 770.474502] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_rules [ 770.474814] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.474920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.661978] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 770.662215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.662377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.662598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.664936] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.664936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.664936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.664936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.664936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.664936] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.818163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.822162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.822162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.822162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.822162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.822162] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 255ec5a6-942e-49be-b759-c091160337f6 already deleted. [ 770.822162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.822162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.822162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.822162] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.833997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5abe3f6a-ae52-49b5-b42b-cb28985f918d [ 770.833997] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.833997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.833997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.833997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.833997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.833997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5abe3f6a-ae52-49b5-b42b-cb28985f918d already deleted. [ 770.833997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5abe3f6a-ae52-49b5-b42b-cb28985f918d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.886915] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.085408] env[62620]: INFO networking_nsxv3.common.synchronization [None req-bf9f6902-2d53-4dc6-93c5-995b690493c8 None None] Enqueued Resource ID: 02eb757f-0087-41ec-adea-9f3d61445049 with Priority: HIGHEST for action port [ 771.086212] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02eb757f-0087-41ec-adea-9f3d61445049 with Priority: HIGHEST for action port [ 771.086549] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-02eb757f-0087-41ec-adea-9f3d61445049 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.087349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02eb757f-0087-41ec-adea-9f3d61445049" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.087349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02eb757f-0087-41ec-adea-9f3d61445049" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.087556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02eb757f-0087-41ec-adea-9f3d61445049" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.087556] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02eb757f-0087-41ec-adea-9f3d61445049',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.127483] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-3143bd41-05e4-4796-8f6d-8c9c80a31b8e tempest-ListServersNegativeTestJSON-1492694773 tempest-ListServersNegativeTestJSON-1492694773-project-member] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 771.128295] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 771.129416] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.129416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.129416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.129416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.129416] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.129416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.129416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.133093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.133093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.133093] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.166211] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.166454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.166527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.166754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.166838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.167052] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.167196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.167362] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.167362] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.167601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.167601] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 771.199682] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.199944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.199944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.200187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.200187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.209864] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 771.344552] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.344711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.344795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.345111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.345257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.345333] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 255ec5a6-942e-49be-b759-c091160337f6 already deleted. [ 771.345613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.389911] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.389911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.390057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.390213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.390307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.390409] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e is going to be created. [ 771.416695] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.416829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.416874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.417353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.417353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.431092] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e in Status: UNINITIALIZED for 2s [ 771.518330] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-6808f94a-e3c9-44ac-ac5c-b5ebad762612 service nova] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_rules [ 771.518330] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-6808f94a-e3c9-44ac-ac5c-b5ebad762612 service nova] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 771.518464] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-6808f94a-e3c9-44ac-ac5c-b5ebad762612 service nova] Enqueued Resource ID: 0f9d4335-0759-496e-8e45-fec3775be050 with Priority: HIGHEST for action port [ 771.518990] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_rules [ 771.519153] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 771.519834] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9d4335-0759-496e-8e45-fec3775be050 with Priority: HIGHEST for action port [ 771.520178] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.520307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.520371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.520643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.520936] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.521556] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.521658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.521854] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f9d4335-0759-496e-8e45-fec3775be050 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.521946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f9d4335-0759-496e-8e45-fec3775be050" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.522358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f9d4335-0759-496e-8e45-fec3775be050" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.522358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f9d4335-0759-496e-8e45-fec3775be050" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.522358] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9d4335-0759-496e-8e45-fec3775be050',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.593482] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02eb757f-0087-41ec-adea-9f3d61445049 [ 771.593482] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.593697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.593744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.593930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.594023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.594180] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02eb757f-0087-41ec-adea-9f3d61445049 already deleted. [ 771.594239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02eb757f-0087-41ec-adea-9f3d61445049" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.633309] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.816632] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.816876] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.817048] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.817542] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.817917] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.818528] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.818872] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.819071] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.820247] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.820247] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.820247] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.821490] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.821661] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.821799] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.821913] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.822281] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.826512] env[62620]: INFO networking_nsxv3.common.synchronization [None req-06f9c919-72c8-4b9e-80f6-d722538b4bb5 None None] Enqueued Resource ID: 68d2c131-00dc-4aa2-ba88-29e81bc6f91d with Priority: HIGHEST for action port [ 771.826512] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68d2c131-00dc-4aa2-ba88-29e81bc6f91d with Priority: HIGHEST for action port [ 771.826970] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-68d2c131-00dc-4aa2-ba88-29e81bc6f91d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.826970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68d2c131-00dc-4aa2-ba88-29e81bc6f91d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.826970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68d2c131-00dc-4aa2-ba88-29e81bc6f91d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.827292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68d2c131-00dc-4aa2-ba88-29e81bc6f91d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.827407] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68d2c131-00dc-4aa2-ba88-29e81bc6f91d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.842615] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.842843] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 771.843121] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.843204] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.843601] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.843881] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.843969] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.844389] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.844685] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.026618] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.026949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.026949] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f9d4335-0759-496e-8e45-fec3775be050 with status ACTIVE [ 772.027051] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.027187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.027252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.027462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.027546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.027718] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.027812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.027872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.028027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.028112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.028293] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.028381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.028441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.028576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.028648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.028728] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f9d4335-0759-496e-8e45-fec3775be050 is going to be updated. [ 772.050876] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.052170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.052170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.052250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.052440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.052955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f9d4335-0759-496e-8e45-fec3775be050" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.136643] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.331727] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68d2c131-00dc-4aa2-ba88-29e81bc6f91d [ 772.331918] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.332452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.332545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.336105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.336105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.336105] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68d2c131-00dc-4aa2-ba88-29e81bc6f91d already deleted. [ 772.336105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68d2c131-00dc-4aa2-ba88-29e81bc6f91d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.348958] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.349181] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.349308] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.349629] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.349742] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.349895] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee not found, creating... [ 772.350188] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.350488] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.350488] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.350681] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.350818] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.351169] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.351502] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.351502] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.351673] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.351809] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.351965] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee is going to be created. [ 772.372878] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.372878] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.372878] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.373228] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.373541] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.373827] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.639552] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.639728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.639803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.640921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.640921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.640921] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be created. [ 772.665715] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.665715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.665715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.665715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.665715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.675317] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: UNINITIALIZED for 2s [ 773.142832] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-132e2736-fd7e-426b-8e79-408e1bf4d176 service nova] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_rules [ 773.142832] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-132e2736-fd7e-426b-8e79-408e1bf4d176 service nova] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 773.142832] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-132e2736-fd7e-426b-8e79-408e1bf4d176 service nova] Enqueued Resource ID: 6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee with Priority: HIGHEST for action port [ 773.143408] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_rules [ 773.143545] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 773.143641] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee with Priority: HIGHEST for action port [ 773.144091] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.144227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.144415] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.146471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.146471] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.146471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.146471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.146471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.146471] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.220293] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 773.220735] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 deletion is rescheduled due to dependency. [ 773.220845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.439966] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e in Status: SUCCESS [ 773.440279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.440451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.440668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.440861] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.440990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.442621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.442621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.442703] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.442738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.442983] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.647842] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee with status ACTIVE [ 773.648135] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.648321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.648404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.648890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.648932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.649316] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.649316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.649508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.649738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.649827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.650026] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.650686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.650686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.650686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.650686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.650686] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee is going to be updated. [ 773.679558] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.679713] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.679778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.679991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.680396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.680396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d227bba-fdfe-4963-87cf-9c8bc5e7d9ee" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.947731] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.452058] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa37dde5-b59c-4c95-8712-27727dd6ae4e: rpc.has_security_group_logging(os_id): False [ 774.475720] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.475882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.475956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.476208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.476306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.476552] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.476655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.476722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.476920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.476963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.477069] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e is going to be created. [ 774.532433] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.532570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.532660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.532851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.533037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.544633] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e in Status: IN_PROGRESS for 2s [ 774.687364] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 774.687364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.687364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.687364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.687364] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.687364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.687364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.687364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.687364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.687364] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.192412] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.697771] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.074784] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-b8ac08a7-15ce-4cfc-b71d-4b2f9da6fc54 tempest-ListServersNegativeTestJSON-1492694773 tempest-ListServersNegativeTestJSON-1492694773-project-member] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 776.075361] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 776.076263] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.076401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.199557] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.199715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.199788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.200038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.200137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.200242] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be updated. [ 776.245648] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.245648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.245648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.245648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.245648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.253956] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 776.281294] env[62620]: INFO networking_nsxv3.common.synchronization [None req-6b8c4d1e-cd7a-4074-9ef8-54744689243a None None] Enqueued Resource ID: a2ba28ae-3de4-4b17-9153-388c76ddd0e4 with Priority: HIGHEST for action port [ 776.281862] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ba28ae-3de4-4b17-9153-388c76ddd0e4 with Priority: HIGHEST for action port [ 776.282282] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ba28ae-3de4-4b17-9153-388c76ddd0e4 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.282413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ba28ae-3de4-4b17-9153-388c76ddd0e4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.282496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ba28ae-3de4-4b17-9153-388c76ddd0e4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.282780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ba28ae-3de4-4b17-9153-388c76ddd0e4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.282866] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ba28ae-3de4-4b17-9153-388c76ddd0e4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.500015] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.500326] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.500533] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.500955] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.501378] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.501534] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.503139] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.503139] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.503139] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.503139] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.503139] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.503139] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.503139] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.503908] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.503908] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.503908] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.523230] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.524482] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.524482] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.524482] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-175" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.524482] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.524482] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.524482] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.524981] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.524981] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.556074] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e in Status: SUCCESS [ 776.556290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.786677] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2ba28ae-3de4-4b17-9153-388c76ddd0e4 [ 776.786947] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.787678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.787678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.787678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.787678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.787678] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2ba28ae-3de4-4b17-9153-388c76ddd0e4 already deleted. [ 776.787678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ba28ae-3de4-4b17-9153-388c76ddd0e4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.028219] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.029592] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.029592] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.029592] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.029592] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.029871] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b not found, creating... [ 777.031661] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.031661] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.031661] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.031661] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.031661] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.031955] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.032128] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.032257] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.032613] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.032938] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.033214] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b is going to be created. [ 777.060214] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.060214] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.060515] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.060856] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.061081] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.061343] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.474547] env[62620]: INFO networking_nsxv3.common.synchronization [req-a7bb1d6e-09e0-4ce2-8618-e08379ecc82a req-ca7a561e-7132-475d-aab8-22afac956201 tempest-SecurityGroupRulesTestJSON-29672729 tempest-SecurityGroupRulesTestJSON-29672729-project-member] Enqueued Resource ID: e59a4fe6-bc53-4095-ad7f-ec7c9bbc79a8 with Priority: HIGHEST for action security_group_rules [ 777.475984] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e59a4fe6-bc53-4095-ad7f-ec7c9bbc79a8 with Priority: HIGHEST for action security_group_rules [ 777.475984] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e59a4fe6-bc53-4095-ad7f-ec7c9bbc79a8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.475984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e59a4fe6-bc53-4095-ad7f-ec7c9bbc79a8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.475984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e59a4fe6-bc53-4095-ad7f-ec7c9bbc79a8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.475984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e59a4fe6-bc53-4095-ad7f-ec7c9bbc79a8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.475984] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e59a4fe6-bc53-4095-ad7f-ec7c9bbc79a8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.512081] env[62620]: INFO networking_nsxv3.common.synchronization [req-e33b7f68-a065-4361-afff-ba33ca167387 req-5f6d7054-5b91-461f-bd71-a231efcc7571 tempest-ServersAdminNegativeTestJSON-337070548 tempest-ServersAdminNegativeTestJSON-337070548-project-member] Enqueued Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 777.513414] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 777.513760] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.513951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.513951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.515271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.515271] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.515271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.515271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.515271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.515271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.516360] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.951678] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-9934e52a-4eeb-4940-9773-4f9959e4c52f service nova] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_rules [ 777.951678] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-9934e52a-4eeb-4940-9773-4f9959e4c52f service nova] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 777.951678] env[62620]: INFO networking_nsxv3.common.synchronization [req-7e3fd573-9e49-4953-8745-60fbe2306a32 req-9934e52a-4eeb-4940-9773-4f9959e4c52f service nova] Enqueued Resource ID: ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b with Priority: HIGHEST for action port [ 777.951678] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_rules [ 777.951678] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 777.951678] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b with Priority: HIGHEST for action port [ 777.953462] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.953462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.953682] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.953682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.954543] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.954543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.954543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.954543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.954543] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.995762] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.995904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.995978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.996210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.996349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.996399] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e59a4fe6-bc53-4095-ad7f-ec7c9bbc79a8 already deleted. [ 777.996513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e59a4fe6-bc53-4095-ad7f-ec7c9bbc79a8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.019899] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.127180] env[62620]: INFO networking_nsxv3.common.synchronization [req-50582ed0-c3f8-4b55-b7c9-c50c5c3e6337 req-3eeb8539-c7da-4044-8f72-c2fafbe33264 tempest-SecurityGroupRulesTestJSON-29672729 tempest-SecurityGroupRulesTestJSON-29672729-project-member] Enqueued Resource ID: 13349dd8-6579-4f5d-9ce0-5ecb49df8831 with Priority: HIGHEST for action security_group_rules [ 778.128230] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13349dd8-6579-4f5d-9ce0-5ecb49df8831 with Priority: HIGHEST for action security_group_rules [ 778.128230] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13349dd8-6579-4f5d-9ce0-5ecb49df8831 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.128230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13349dd8-6579-4f5d-9ce0-5ecb49df8831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.128230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13349dd8-6579-4f5d-9ce0-5ecb49df8831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.128702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13349dd8-6579-4f5d-9ce0-5ecb49df8831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.128702] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13349dd8-6579-4f5d-9ce0-5ecb49df8831',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.264374] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 778.264374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.264374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.264582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.264621] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.264722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.264783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.264937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.265029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.265120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.265219] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.270037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.270268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.270449] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.270718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.270718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.270888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.270888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.270970] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.458109] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b with status ACTIVE [ 778.458109] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.458109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.458109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.458109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.458109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.458109] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.458109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.458109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.458109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.458109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.458109] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.458109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.459061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.459061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.459061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.459061] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b is going to be updated. [ 778.479588] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.479736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.479808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.480036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.480176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.480358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffc6e4e3-3dcd-43a4-8fa4-dc9c8ffa3e2b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.522095] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.658494] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.658494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.658494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.658494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.658494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.658791] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13349dd8-6579-4f5d-9ce0-5ecb49df8831 already deleted. [ 778.658791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13349dd8-6579-4f5d-9ce0-5ecb49df8831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.711566] env[62620]: INFO networking_nsxv3.common.synchronization [None req-eb5bccf3-402c-4101-b116-537f9b17633d None None] Enqueued Resource ID: d22eb981-5f3e-4da0-ae27-d5c44896702f with Priority: HIGHEST for action port [ 778.715028] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22eb981-5f3e-4da0-ae27-d5c44896702f with Priority: HIGHEST for action port [ 778.715028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-d22eb981-5f3e-4da0-ae27-d5c44896702f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.715028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d22eb981-5f3e-4da0-ae27-d5c44896702f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.715028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d22eb981-5f3e-4da0-ae27-d5c44896702f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.715028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d22eb981-5f3e-4da0-ae27-d5c44896702f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.715028] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d22eb981-5f3e-4da0-ae27-d5c44896702f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.772269] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.772396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.772631] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.861021] env[62620]: INFO networking_nsxv3.common.synchronization [req-de97227e-ec6d-4f20-8fd2-bedd1e3a9a75 req-7d3f437d-d99f-48d3-9b17-5028336ed006 tempest-SecurityGroupRulesTestJSON-29672729 tempest-SecurityGroupRulesTestJSON-29672729-project-member] Enqueued Resource ID: 25324d0b-a63f-4e5b-8088-0d9cb3f3cd52 with Priority: HIGHEST for action security_group_rules [ 778.861656] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25324d0b-a63f-4e5b-8088-0d9cb3f3cd52 with Priority: HIGHEST for action security_group_rules [ 778.861845] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25324d0b-a63f-4e5b-8088-0d9cb3f3cd52 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.861970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25324d0b-a63f-4e5b-8088-0d9cb3f3cd52" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.865959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25324d0b-a63f-4e5b-8088-0d9cb3f3cd52" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.866298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25324d0b-a63f-4e5b-8088-0d9cb3f3cd52" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.866394] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25324d0b-a63f-4e5b-8088-0d9cb3f3cd52',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.025901] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.026252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.026252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.026370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.026422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.026519] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 is going to be updated. [ 779.051876] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.052055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.052133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.052333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.052494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.062853] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: IN_PROGRESS for 2s [ 779.214487] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d22eb981-5f3e-4da0-ae27-d5c44896702f [ 779.214735] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.214875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.214947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.215655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.215655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.215655] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d22eb981-5f3e-4da0-ae27-d5c44896702f already deleted. [ 779.215655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d22eb981-5f3e-4da0-ae27-d5c44896702f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.274885] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.392039] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.392039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.392039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.392039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.392039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.392039] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25324d0b-a63f-4e5b-8088-0d9cb3f3cd52 already deleted. [ 779.392039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25324d0b-a63f-4e5b-8088-0d9cb3f3cd52" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.773846] env[62620]: INFO networking_nsxv3.common.synchronization [req-9196fa40-c789-4871-98d3-be7604e38c93 req-5bbf3d87-b353-4b36-a756-f93841b081d7 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 779.774472] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 779.774801] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.774929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.774970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.775467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.775646] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.775802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.775959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.776019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.776087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.776179] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.778864] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.779715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.779715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.779715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.779715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.779715] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be updated. [ 779.814958] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.815784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.816348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.816996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.817371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.831442] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 779.981798] env[62620]: INFO networking_nsxv3.common.synchronization [req-637c56fe-e301-4588-8c00-8af865b0103b req-e06b30aa-c628-42d8-894b-586a9be05419 tempest-SecurityGroupRulesTestJSON-29672729 tempest-SecurityGroupRulesTestJSON-29672729-project-member] Enqueued Resource ID: 16ab4042-878a-4451-8525-f62b7dab9a0f with Priority: HIGHEST for action security_group_rules [ 779.982345] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ab4042-878a-4451-8525-f62b7dab9a0f with Priority: HIGHEST for action security_group_rules [ 779.982644] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16ab4042-878a-4451-8525-f62b7dab9a0f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.982757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16ab4042-878a-4451-8525-f62b7dab9a0f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.982819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16ab4042-878a-4451-8525-f62b7dab9a0f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.983403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16ab4042-878a-4451-8525-f62b7dab9a0f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.983496] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16ab4042-878a-4451-8525-f62b7dab9a0f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.279291] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.279599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.279599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.280291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.280291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.280291] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.280291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.280291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.280525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.280525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.280525] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 already deleted. [ 780.280648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.427980] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.428214] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-357" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.428346] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-357" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.428686] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-357" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.428952] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.429348] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.429484] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.429711] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.429857] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.431273] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.431447] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.431574] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.431692] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.431813] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.431925] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.432079] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.449553] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.449553] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.449553] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.449739] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-357" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.450098] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.450926] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.450926] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.451209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.451209] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.513380] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.513729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.513987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.514595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.515235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.515235] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16ab4042-878a-4451-8525-f62b7dab9a0f already deleted. [ 780.515235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16ab4042-878a-4451-8525-f62b7dab9a0f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.916645] env[62620]: INFO networking_nsxv3.common.synchronization [req-0dd0aa28-7598-400a-81d0-c7ebddce1f3c req-53a4701b-82a9-410e-9ce9-1d4b5e207f93 tempest-SecurityGroupRulesTestJSON-29672729 tempest-SecurityGroupRulesTestJSON-29672729-project-member] Enqueued Resource ID: d9284803-e5be-4bbf-8958-768574edd08d with Priority: HIGHEST for action security_group_rules [ 780.917177] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9284803-e5be-4bbf-8958-768574edd08d with Priority: HIGHEST for action security_group_rules [ 780.917480] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9284803-e5be-4bbf-8958-768574edd08d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.917587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.917683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.917925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.918016] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9284803-e5be-4bbf-8958-768574edd08d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.953226] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.953494] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.953658] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.953900] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.954069] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.954273] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 not found, creating... [ 780.955042] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.955042] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.955042] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.955233] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.955233] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.955481] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.955635] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.955751] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.955957] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.956122] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.956265] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 is going to be created. [ 780.975482] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.975702] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.975894] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.976262] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.976503] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.976741] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.073199] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: SUCCESS [ 781.073525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.196487] env[62620]: INFO networking_nsxv3.common.synchronization [req-dee7ac5c-a1ef-4c3b-ac00-b6c7cbac5a35 req-83b38a82-9f40-43e4-8b92-91f21f50b45a tempest-SecurityGroupRulesTestJSON-29672729 tempest-SecurityGroupRulesTestJSON-29672729-project-member] Enqueued Resource ID: d9284803-e5be-4bbf-8958-768574edd08d with Priority: HIGHEST for action security_group_rules [ 781.196997] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9284803-e5be-4bbf-8958-768574edd08d with Priority: HIGHEST for action security_group_rules [ 781.197336] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9284803-e5be-4bbf-8958-768574edd08d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.197443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.430433] env[62620]: INFO networking_nsxv3.common.synchronization [req-e5031194-4eaf-48ba-b49e-31f382a47d04 req-8afdc404-aac8-4162-8e57-6ccdd2e95675 tempest-SecurityGroupRulesTestJSON-29672729 tempest-SecurityGroupRulesTestJSON-29672729-project-member] Enqueued Resource ID: d9284803-e5be-4bbf-8958-768574edd08d with Priority: HIGHEST for action security_group_rules [ 781.431083] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9284803-e5be-4bbf-8958-768574edd08d with Priority: HIGHEST for action security_group_rules [ 781.431436] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9284803-e5be-4bbf-8958-768574edd08d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.431589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.437400] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.437526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.437619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.437827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.437917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.438015] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9284803-e5be-4bbf-8958-768574edd08d already deleted. [ 781.438107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.438241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.438397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.438540] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9284803-e5be-4bbf-8958-768574edd08d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.791623] env[62620]: INFO networking_nsxv3.common.synchronization [req-9196fa40-c789-4871-98d3-be7604e38c93 req-11bc9a9b-f09a-4eea-ad14-08f52870899c service nova] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_rules [ 781.792250] env[62620]: INFO networking_nsxv3.common.synchronization [req-9196fa40-c789-4871-98d3-be7604e38c93 req-11bc9a9b-f09a-4eea-ad14-08f52870899c service nova] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 781.792250] env[62620]: INFO networking_nsxv3.common.synchronization [req-9196fa40-c789-4871-98d3-be7604e38c93 req-11bc9a9b-f09a-4eea-ad14-08f52870899c service nova] Enqueued Resource ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 with Priority: HIGHEST for action port [ 781.792606] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_rules [ 781.792775] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 781.792913] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 with Priority: HIGHEST for action port [ 781.793253] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.793434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.793526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.793819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.794067] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.794940] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.795127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.795127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.795227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.795623] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.795623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.795623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.795787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.795787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.796868] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.796868] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.796868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.797203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.797203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.797345] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.841068] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 781.841303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.841791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.842008] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.845017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.845017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.845017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.845017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.845017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.845017] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.963538] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.964443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.964554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.964737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.964831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.964932] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9284803-e5be-4bbf-8958-768574edd08d already deleted. [ 781.965030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.965188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.966156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.966156] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9284803-e5be-4bbf-8958-768574edd08d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.299338] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.300390] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.300494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.303031] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 with status ACTIVE [ 782.303946] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.303946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.303946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.303946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.303946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.303946] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.304319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.304319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.304319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.304469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.304505] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.304600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.304655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.304798] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.304873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.304958] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 is going to be updated. [ 782.326388] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.326388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.326388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.326388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.326388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.326388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.346313] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.485547] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.485547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.485547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.485547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.485547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.485547] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9284803-e5be-4bbf-8958-768574edd08d already deleted. [ 782.485547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9284803-e5be-4bbf-8958-768574edd08d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.740231] env[62620]: INFO networking_nsxv3.common.synchronization [req-ccb2ebb8-3b3b-4648-96ff-529769dc2666 req-90ff7cae-a0b2-4867-88fe-d1a6adc96061 tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 782.740231] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 782.740231] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.740231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.741107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.741690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.742077] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.742396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.742594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.742890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.743210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.743465] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.804028] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.851086] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.209296] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.209531] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.209667] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.210407] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.210737] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.210961] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.211163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.211500] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.211740] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.212116] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 783.212355] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.212580] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.212815] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.213045] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 783.213448] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.213540] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.231563] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.231720] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 783.231992] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.232264] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.232621] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.232824] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.232952] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.233343] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.233490] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33dc8116-8cea-41e8-8ac1-a7f42c7bca81',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.246491] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.246672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.246715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.247640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.247743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.247951] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.248066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.248128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.248294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.248397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.248480] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 already deleted. [ 783.248563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.307448] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.307448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.307448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.307776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.310937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.310937] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 is going to be created. [ 783.333104] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.333329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.333433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.335235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.335235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.341868] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: UNINITIALIZED for 2s [ 783.354428] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.354652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.354728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.355097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.355215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.355339] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be updated. [ 783.381996] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.382184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.382265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.382476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.385019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.393364] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 783.736523] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.737057] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.737057] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.737471] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.737724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.737943] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 33dc8116-8cea-41e8-8ac1-a7f42c7bca81 not found, creating... [ 783.738363] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.738633] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.739221] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.739923] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.740069] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.740493] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.740762] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.740988] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.741415] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.741554] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.741663] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 33dc8116-8cea-41e8-8ac1-a7f42c7bca81 is going to be created. [ 783.763357] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.763695] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.763695] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.763957] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.764201] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.764458] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.520217] env[62620]: INFO networking_nsxv3.common.synchronization [req-ccb2ebb8-3b3b-4648-96ff-529769dc2666 req-a6cba5d1-6094-4d83-8e7c-0af80e9674d2 service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 784.520493] env[62620]: INFO networking_nsxv3.common.synchronization [req-ccb2ebb8-3b3b-4648-96ff-529769dc2666 req-a6cba5d1-6094-4d83-8e7c-0af80e9674d2 service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 784.520706] env[62620]: INFO networking_nsxv3.common.synchronization [req-ccb2ebb8-3b3b-4648-96ff-529769dc2666 req-a6cba5d1-6094-4d83-8e7c-0af80e9674d2 service nova] Enqueued Resource ID: 33dc8116-8cea-41e8-8ac1-a7f42c7bca81 with Priority: HIGHEST for action port [ 784.521373] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 784.521568] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 784.521752] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33dc8116-8cea-41e8-8ac1-a7f42c7bca81 with Priority: HIGHEST for action port [ 784.522431] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.522431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.522431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.522770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.522882] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.524349] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.524506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.524613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.524850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.525121] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.525268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.525357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.525565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.525684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.525824] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.527056] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.528824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.528824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.528824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.528824] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33dc8116-8cea-41e8-8ac1-a7f42c7bca81',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.030067] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.030067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.032226] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.033797] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33dc8116-8cea-41e8-8ac1-a7f42c7bca81 with status ACTIVE [ 785.033797] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.033797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.033797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.033797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.033797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.034220] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.034220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.034220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.034220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.034390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.034687] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.034836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.034931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.034997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.035135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.035241] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33dc8116-8cea-41e8-8ac1-a7f42c7bca81 is going to be updated. [ 785.054923] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.055350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.055350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.055350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.055510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.055671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33dc8116-8cea-41e8-8ac1-a7f42c7bca81" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.350729] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: SUCCESS [ 785.351121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.351354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.351841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.351841] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.351984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.352070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.352294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.352420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.352563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.352671] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.404127] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 785.404388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.404569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.405329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.405649] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.405745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.405819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.405994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.406091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.406203] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.530651] env[62620]: INFO networking_nsxv3.common.synchronization [req-8febe364-149c-4fbd-9ea6-d846a49845ef req-0683c654-c9ef-4a33-a680-f4dc47c0ef06 tempest-FloatingIPsAssociationTestJSON-1435038635 tempest-FloatingIPsAssociationTestJSON-1435038635-project-member] Enqueued Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 785.532015] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 785.532395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.532525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.532593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.532807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.533248] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.533248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.533248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.533645] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.533645] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.533645] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.538889] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.855865] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.856055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.856128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.856393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.856572] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.856679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.856742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.856892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.856977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.857075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.857223] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.857313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.857370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.857508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.857680] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.857773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.857831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.857994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.858075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.858157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.858243] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.908430] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.043467] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.044635] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.044771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.044845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.045087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.045181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.045266] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be created. [ 786.068551] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.068713] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.068776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.068978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.069183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.079469] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: UNINITIALIZED for 2s [ 786.138087] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-176 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.138371] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-176" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.138604] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-176" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.142489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-176" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.142866] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.143655] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.143655] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.143655] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.143655] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.143914] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.143960] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.144063] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.147444] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.147444] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.147444] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.147444] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.163973] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.164175] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 786.164389] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.164627] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-176" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.164955] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.165139] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.165267] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.165597] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.165734] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbeb1b12-c6f2-470f-a952-37da5b4db0c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.360508] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17cad687-b90b-448c-be96-2ad4dc207d55: rpc.has_security_group_logging(os_id): False [ 786.380321] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.380321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.380321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.380321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.380321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.380582] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.380582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.380711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.380788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.380866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.381091] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.381185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.381246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.381392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.381462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.381647] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.381751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.381810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.381947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.382205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.382343] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 is going to be created. [ 786.411106] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.440484] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.440484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.440484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.440484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.440794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.452919] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: IN_PROGRESS for 2s [ 786.551341] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.670511] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.670752] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.670909] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.671241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.671359] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.671528] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port bbeb1b12-c6f2-470f-a952-37da5b4db0c9 not found, creating... [ 786.671806] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.671967] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.672099] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.672331] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.672474] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.672764] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.673444] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.673668] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.673909] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.674064] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.674216] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: bbeb1b12-c6f2-470f-a952-37da5b4db0c9 is going to be created. [ 786.695811] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.695939] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.696073] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.696419] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.696768] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.696972] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.913805] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.914064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.914144] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.914805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.916074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.916272] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be updated. [ 786.950273] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.950417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.950487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.950722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.950867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.963222] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 787.060358] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.060358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.060358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.060358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.060358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.060358] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 is going to be updated. [ 787.121362] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.121538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.121622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.122405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.123023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.142042] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: IN_PROGRESS for 2s [ 787.470346] env[62620]: INFO networking_nsxv3.common.synchronization [None req-78bf8a91-d0fb-4397-a1cf-13aa76293aa4 None None] Enqueued Resource ID: a6ac8f46-08ea-49c9-bd99-afa66a65a9b3 with Priority: HIGHEST for action port [ 787.470346] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac8f46-08ea-49c9-bd99-afa66a65a9b3 with Priority: HIGHEST for action port [ 787.470346] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6ac8f46-08ea-49c9-bd99-afa66a65a9b3 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.470346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6ac8f46-08ea-49c9-bd99-afa66a65a9b3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.470346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6ac8f46-08ea-49c9-bd99-afa66a65a9b3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.470346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6ac8f46-08ea-49c9-bd99-afa66a65a9b3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.470615] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6ac8f46-08ea-49c9-bd99-afa66a65a9b3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.584168] env[62620]: INFO networking_nsxv3.common.synchronization [req-8febe364-149c-4fbd-9ea6-d846a49845ef req-a2f1bef9-8b8d-4847-8b67-9ad472046aae service nova] Enqueued Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_rules [ 787.584785] env[62620]: INFO networking_nsxv3.common.synchronization [req-8febe364-149c-4fbd-9ea6-d846a49845ef req-a2f1bef9-8b8d-4847-8b67-9ad472046aae service nova] Enqueued Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 787.584785] env[62620]: INFO networking_nsxv3.common.synchronization [req-8febe364-149c-4fbd-9ea6-d846a49845ef req-a2f1bef9-8b8d-4847-8b67-9ad472046aae service nova] Enqueued Resource ID: bbeb1b12-c6f2-470f-a952-37da5b4db0c9 with Priority: HIGHEST for action port [ 787.584785] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_rules [ 787.584996] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 787.584996] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb1b12-c6f2-470f-a952-37da5b4db0c9 with Priority: HIGHEST for action port [ 787.585561] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.585707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.585743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.585944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.591143] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.592458] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.592974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.593277] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.593425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.593592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.593738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.593841] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbeb1b12-c6f2-470f-a952-37da5b4db0c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.975417] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6ac8f46-08ea-49c9-bd99-afa66a65a9b3 [ 787.975417] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.975417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.975417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.975417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.975417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.975417] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6ac8f46-08ea-49c9-bd99-afa66a65a9b3 already deleted. [ 787.975417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6ac8f46-08ea-49c9-bd99-afa66a65a9b3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.089217] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 788.089217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.089217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.089217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.089217] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.089217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.089217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.089931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.089931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.089931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.089931] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.096487] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.096794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.096989] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbeb1b12-c6f2-470f-a952-37da5b4db0c9 with status ACTIVE [ 788.097212] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.097328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.097409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.097576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.097676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.097813] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.097900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.097980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.098113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.098914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.098914] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.098914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.098914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.098914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.098914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.098914] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbeb1b12-c6f2-470f-a952-37da5b4db0c9 is going to be updated. [ 788.118590] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.119015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.119015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.119015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.119209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.119392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbeb1b12-c6f2-470f-a952-37da5b4db0c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.251142] env[62620]: INFO networking_nsxv3.common.synchronization [req-8e5b14b3-5679-493d-a7e7-8e40a8c452ea req-c2ae86ec-ffba-412a-b78b-5a0ffbe98430 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 788.251751] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 788.253338] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.253493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.253559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.253821] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.253988] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.254104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.254167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.254325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.254611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.254611] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.463637] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: SUCCESS [ 788.463876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.592045] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.592346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.592346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.594370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.594608] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.595622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.595715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.595948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.596058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.596156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.596348] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.596507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.596507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.598272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.598272] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.598272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.598272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.598272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.598272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.598272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.598272] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.756291] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.756478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.756572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.756751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.756844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.757056] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.757178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.757241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.757362] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.757440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.757527] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a already deleted. [ 788.757592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.974775] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 788.975014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.975203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.975437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.975658] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.975780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.975845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.976009] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.976102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.976246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.976355] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.976501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.976540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.976690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.976830] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.976926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.977026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.979513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.979718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.979773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.979837] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.103261] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c995751-5151-4812-a1e5-510ea09222e0: rpc.has_security_group_logging(os_id): False [ 789.121503] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.121647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.121775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.121978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.122116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.122345] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.122465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.122530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.122690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.122765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.123179] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.123179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.123179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.123404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.123469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.123819] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.124106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.124106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.124277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.124277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.124402] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be created. [ 789.150952] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: SUCCESS [ 789.151261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.151460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.151684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.151762] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.151953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.151953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.152135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.152220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.152318] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.186447] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.186673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.186763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.187034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.187278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.197687] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 789.242572] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.242783] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-416" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.242909] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-416" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.243386] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-416" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.243578] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.243745] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.244373] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.244688] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.244688] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.244866] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.244987] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.245164] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.246038] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.246192] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.246316] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.246459] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.267932] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.268048] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 789.268243] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.268389] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-416" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.268715] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-5db92929-a96d-41c2-be2b-95c9ef62c4bf taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.268891] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.270311] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.270778] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.270938] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db92929-a96d-41c2-be2b-95c9ef62c4bf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.483162] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff: rpc.has_security_group_logging(os_id): False [ 789.500099] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.500268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.500317] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.500603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.500714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.500918] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.501039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.501110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.501268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.501346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.501546] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.501635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.501700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.501868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.501913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.502158] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.502260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.502349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.502474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.502538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.502627] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be created. [ 789.557096] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.557263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.557313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.557517] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.557693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.570937] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 789.655474] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.773085] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.773403] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.773565] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.773871] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.775171] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.775171] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 5db92929-a96d-41c2-be2b-95c9ef62c4bf not found, creating... [ 789.775171] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.775171] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.775171] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.775171] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.775171] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.775481] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.775634] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.775760] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.776095] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.780445] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.780523] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf is going to be created. [ 789.804066] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.804329] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.804439] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.804716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.804954] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.805320] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.074859] env[62620]: INFO networking_nsxv3.common.synchronization [None req-07991aa3-646c-47fb-a266-802aba46985a None None] Enqueued Resource ID: 7ee6a1ed-064c-4f76-a37a-76f6c4dc0264 with Priority: HIGHEST for action port [ 790.075418] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee6a1ed-064c-4f76-a37a-76f6c4dc0264 with Priority: HIGHEST for action port [ 790.076158] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ee6a1ed-064c-4f76-a37a-76f6c4dc0264 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.076338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ee6a1ed-064c-4f76-a37a-76f6c4dc0264" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.076411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ee6a1ed-064c-4f76-a37a-76f6c4dc0264" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.076932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ee6a1ed-064c-4f76-a37a-76f6c4dc0264" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.076932] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ee6a1ed-064c-4f76-a37a-76f6c4dc0264',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.159092] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.580020] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ee6a1ed-064c-4f76-a37a-76f6c4dc0264 [ 790.580020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.580020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.580020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.580537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.580537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.580702] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ee6a1ed-064c-4f76-a37a-76f6c4dc0264 already deleted. [ 790.580772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ee6a1ed-064c-4f76-a37a-76f6c4dc0264" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.661398] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.661640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.661765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.662013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.662115] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.662220] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 is going to be updated. [ 790.690441] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.690579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.690682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.690992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.691231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.699748] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: IN_PROGRESS for 2s [ 790.824307] env[62620]: INFO networking_nsxv3.common.synchronization [req-8e5b14b3-5679-493d-a7e7-8e40a8c452ea req-479e6da9-dd1f-43c3-8ebb-6900a4e6cabe service nova] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 790.824519] env[62620]: INFO networking_nsxv3.common.synchronization [req-8e5b14b3-5679-493d-a7e7-8e40a8c452ea req-479e6da9-dd1f-43c3-8ebb-6900a4e6cabe service nova] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 790.824669] env[62620]: INFO networking_nsxv3.common.synchronization [req-8e5b14b3-5679-493d-a7e7-8e40a8c452ea req-479e6da9-dd1f-43c3-8ebb-6900a4e6cabe service nova] Enqueued Resource ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf with Priority: HIGHEST for action port [ 790.825337] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 790.825337] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 790.825463] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf with Priority: HIGHEST for action port [ 790.825717] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.825839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.825901] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.826320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.826514] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.827756] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.827846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.827926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.828117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.828267] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.828550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.828550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.828915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.828915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.828915] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.829945] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-5db92929-a96d-41c2-be2b-95c9ef62c4bf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.830093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.830141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.830302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.830388] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db92929-a96d-41c2-be2b-95c9ef62c4bf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.213414] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 791.213655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.335236] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.335236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.335236] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.335868] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5db92929-a96d-41c2-be2b-95c9ef62c4bf with status ACTIVE [ 791.336062] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.336201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.336358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.336446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.336540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.336747] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.336858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.336988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.337885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.337885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.337885] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.337885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.337885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.337885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.337885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.337885] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf is going to be updated. [ 791.360744] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.360894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.360967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.361198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.361342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.361517] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.585249] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 791.585249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.585249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.585249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.585249] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.670141] env[62620]: INFO networking_nsxv3.common.synchronization [req-8a65011e-78d9-423f-b028-9afc812ebe7c req-f4687bca-7ea5-4b93-8abd-5194131eac50 tempest-ListServersNegativeTestJSON-1492694773 tempest-ListServersNegativeTestJSON-1492694773-project-member] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 791.670141] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 791.672727] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.672958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.672958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.673168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.673391] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.673497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.673561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.673722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.673804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.673900] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.840154] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.090735] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.090882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 792.176163] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.343320] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.343320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 792.343320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.343320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 792.343320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.343320] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be created. [ 792.365636] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.366494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 792.366494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.366494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 792.366494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.374885] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: UNINITIALIZED for 2s [ 792.679088] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.710224] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: SUCCESS [ 792.710224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.710475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.710719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 792.710921] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.711055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 792.711125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.711351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 792.711755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.711755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.711755] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.182141] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.182141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.182281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.182462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.182561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.182730] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be updated. [ 793.214059] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.214222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.214348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.214693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.215040] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.215107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.215134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.215305] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.215394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.215485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.215652] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.215748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.215841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.215954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.216108] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.216201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.216265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.216407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.216481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.216564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.216651] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.218475] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.218475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.218646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.218727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.218886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.234731] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 793.721040] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 202f6ed5-23fc-4a56-be57-1b3daf0aed84: rpc.has_security_group_logging(os_id): False [ 793.743063] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.743397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.743562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.743832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.743974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.744331] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.744474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.744578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.744819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.744947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.745246] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.745400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.745532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.745711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.745829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.746118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.746268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.746370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.746587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.746703] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.746829] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 is going to be updated. [ 793.848797] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.848797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.848797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.848797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.848797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.873406] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: IN_PROGRESS for 2s [ 794.384924] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: SUCCESS [ 794.384924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.384924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.385164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.385368] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.385489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.385557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.385715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.385799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.385887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.385977] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.887598] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.244175] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 795.244460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.244662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.244907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.245140] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.245264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.245333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.245494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.245613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.245734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.245825] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.391228] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5055d880-77be-4c89-8a2a-a2e60908e12a: rpc.has_security_group_logging(os_id): False [ 795.412626] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.412819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.412870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.413063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.413154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.413471] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.413558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.413558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.413710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.413774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.413895] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be created. [ 795.467055] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.467055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.467055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.467261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.467510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.477497] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: IN_PROGRESS for 2s [ 795.749163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.749397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.749509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.749846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.750084] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.750230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.750294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.750478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.752021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.752188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.752379] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.752486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.752552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.752728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.752887] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.752983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.753211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.753408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.753496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.753577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.753676] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.941215] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: SUCCESS [ 795.941719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.256666] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff: rpc.has_security_group_logging(os_id): False [ 796.274480] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.274642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.274714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.275012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.275145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.275355] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.275489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.275572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.275853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.275853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.276108] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.276212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.276277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.276427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.276509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.276676] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.276826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.276911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.277088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.277192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.277296] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be updated. [ 796.357515] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.357696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.357930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.357990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.358142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.368400] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 796.671475] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 796.671475] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 797.488634] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: SUCCESS [ 797.488899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.311643] env[62620]: INFO networking_nsxv3.common.synchronization [req-be72c443-c175-4ec4-ae24-4a7654e939c0 req-73aa14f7-53bc-4c52-bcd8-01e9be3bc103 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_members [ 798.312195] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_members [ 798.312549] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.312652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.312715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.312949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.314365] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.314484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.314557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.314726] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.314815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.314917] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.379869] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 798.380654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.381244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.381484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.381575] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.817043] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.817571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.817571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.817571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.817810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.817856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.817948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.818066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.818199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.818283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.818399] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 already deleted. [ 798.818459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.885921] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.885921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.885921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.885921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.885921] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.885921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.885921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.885921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.885921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.885921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.885921] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.390836] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.390993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.391083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.391308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.391497] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.391606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.391708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.391887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.391962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.392063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.392211] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.392304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.392367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.392577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.392709] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.392709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.392990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.392990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.393140] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.393140] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.393214] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.443141] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.443398] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.443524] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.445071] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.445071] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.445071] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.445071] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.445071] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.445071] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.445071] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.445345] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.445345] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.445402] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.445537] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.445594] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.446028] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.463986] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.464212] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.464423] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.464629] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.464993] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-21d30d49-10fb-462d-9b5f-7525c3497178 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.465200] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-21d30d49-10fb-462d-9b5f-7525c3497178" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.465346] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-21d30d49-10fb-462d-9b5f-7525c3497178" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.465645] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-21d30d49-10fb-462d-9b5f-7525c3497178" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.465785] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21d30d49-10fb-462d-9b5f-7525c3497178',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.896599] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff: rpc.has_security_group_logging(os_id): False [ 799.914238] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.914723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.914723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.914723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.914853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.915049] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.915221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.915290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.915447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.915538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.916089] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.916210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.916442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.916638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.916720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.917063] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.917173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.917243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.917400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.917490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.917588] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be updated. [ 799.975064] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.975256] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.975342] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.975637] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.975860] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.975982] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 21d30d49-10fb-462d-9b5f-7525c3497178 not found, creating... [ 799.976268] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.977373] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.977373] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.977373] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.977373] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.977373] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.977577] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.977605] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.977844] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.977988] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.978157] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 21d30d49-10fb-462d-9b5f-7525c3497178 is going to be created. [ 799.980214] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.980320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.980400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.980570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.980716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.997243] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 800.003131] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.003472] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.003624] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.003880] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.004182] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.004483] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-21d30d49-10fb-462d-9b5f-7525c3497178" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.918054] env[62620]: INFO networking_nsxv3.common.synchronization [req-be72c443-c175-4ec4-ae24-4a7654e939c0 req-49f135e6-ed1b-490e-ace6-abc5c6a3395b service nova] Enqueued Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_rules [ 800.918054] env[62620]: INFO networking_nsxv3.common.synchronization [req-be72c443-c175-4ec4-ae24-4a7654e939c0 req-49f135e6-ed1b-490e-ace6-abc5c6a3395b service nova] Enqueued Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_members [ 800.918054] env[62620]: INFO networking_nsxv3.common.synchronization [req-be72c443-c175-4ec4-ae24-4a7654e939c0 req-49f135e6-ed1b-490e-ace6-abc5c6a3395b service nova] Enqueued Resource ID: 21d30d49-10fb-462d-9b5f-7525c3497178 with Priority: HIGHEST for action port [ 800.918435] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_rules [ 800.918435] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_members [ 800.918435] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d30d49-10fb-462d-9b5f-7525c3497178 with Priority: HIGHEST for action port [ 800.919429] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.919429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.919429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.919640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.919700] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.922028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.922152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.922220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.922437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.924970] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.924970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.924970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.924970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.924970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.924970] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.924970] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-21d30d49-10fb-462d-9b5f-7525c3497178 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.924970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21d30d49-10fb-462d-9b5f-7525c3497178" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.924970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21d30d49-10fb-462d-9b5f-7525c3497178" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.924970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21d30d49-10fb-462d-9b5f-7525c3497178" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.924970] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21d30d49-10fb-462d-9b5f-7525c3497178',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.426920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.427093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.427218] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.428237] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21d30d49-10fb-462d-9b5f-7525c3497178 with status ACTIVE [ 801.428460] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.431400] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.431400] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.431400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.431400] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21d30d49-10fb-462d-9b5f-7525c3497178 is going to be updated. [ 801.449855] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.450016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.450099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.450290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.450429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.450584] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21d30d49-10fb-462d-9b5f-7525c3497178" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.615042] env[62620]: INFO networking_nsxv3.common.synchronization [req-851401b7-6193-4d08-b4cb-6075170ab020 req-fe6fb8f2-a572-4716-abe0-f85f98159a04 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 801.615235] env[62620]: INFO networking_nsxv3.common.synchronization [req-851401b7-6193-4d08-b4cb-6075170ab020 req-fe6fb8f2-a572-4716-abe0-f85f98159a04 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 473b7304-d562-4953-af3b-ac19b10b77b9 with Priority: HIGHEST for action security_group_members [ 801.615759] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 801.615910] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473b7304-d562-4953-af3b-ac19b10b77b9 with Priority: HIGHEST for action security_group_members [ 801.617699] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.617699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.617699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.617699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.617699] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.617699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.617699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.617699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.617699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.617699] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.618526] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-473b7304-d562-4953-af3b-ac19b10b77b9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.619502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.619591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.619801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.619946] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.623960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.624031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.624204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.624398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.624457] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('473b7304-d562-4953-af3b-ac19b10b77b9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.673531] env[62620]: INFO networking_nsxv3.common.synchronization [req-851401b7-6193-4d08-b4cb-6075170ab020 req-fe6fb8f2-a572-4716-abe0-f85f98159a04 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_rules [ 801.673729] env[62620]: INFO networking_nsxv3.common.synchronization [req-851401b7-6193-4d08-b4cb-6075170ab020 req-fe6fb8f2-a572-4716-abe0-f85f98159a04 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 801.673870] env[62620]: INFO networking_nsxv3.common.synchronization [req-851401b7-6193-4d08-b4cb-6075170ab020 req-fe6fb8f2-a572-4716-abe0-f85f98159a04 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 473b7304-d562-4953-af3b-ac19b10b77b9 with Priority: HIGHEST for action security_group_rules [ 801.674009] env[62620]: INFO networking_nsxv3.common.synchronization [req-851401b7-6193-4d08-b4cb-6075170ab020 req-fe6fb8f2-a572-4716-abe0-f85f98159a04 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 473b7304-d562-4953-af3b-ac19b10b77b9 with Priority: HIGHEST for action security_group_members [ 801.674146] env[62620]: INFO networking_nsxv3.common.synchronization [req-851401b7-6193-4d08-b4cb-6075170ab020 req-fe6fb8f2-a572-4716-abe0-f85f98159a04 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 with Priority: HIGHEST for action port [ 801.674871] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_rules [ 801.674947] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473b7304-d562-4953-af3b-ac19b10b77b9 with Priority: HIGHEST for action security_group_rules [ 801.675858] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 with Priority: HIGHEST for action port [ 801.675974] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 801.676093] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473b7304-d562-4953-af3b-ac19b10b77b9 with Priority: HIGHEST for action security_group_members [ 801.676414] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.676507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.676607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.676791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.676882] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.677699] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-473b7304-d562-4953-af3b-ac19b10b77b9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.677815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.677882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.678102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.678179] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('473b7304-d562-4953-af3b-ac19b10b77b9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.678904] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.679031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.682514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.682514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.682514] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.682514] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.682514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.682514] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-473b7304-d562-4953-af3b-ac19b10b77b9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.682514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.933017] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.015190] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 802.015190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.126797] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.127713] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('473b7304-d562-4953-af3b-ac19b10b77b9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.183309] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-473b7304-d562-4953-af3b-ac19b10b77b9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.183400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.184028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.184028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.184028] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 with status ACTIVE [ 802.184247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.184247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.184349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.184470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.184565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.184737] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.184825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.184887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.185056] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.185135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.185316] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.185411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.185473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.185647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.185687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.185760] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 is going to be updated. [ 802.210417] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.210555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.210623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.210825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.210962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.211128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.419803] env[62620]: INFO networking_nsxv3.common.synchronization [req-cb42b5b9-b630-4a6d-9cb1-6fa3f99ee08c req-95f9d232-b3f1-4e32-91f6-0bdf02394155 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 802.419976] env[62620]: INFO networking_nsxv3.common.synchronization [req-cb42b5b9-b630-4a6d-9cb1-6fa3f99ee08c req-95f9d232-b3f1-4e32-91f6-0bdf02394155 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 473b7304-d562-4953-af3b-ac19b10b77b9 with Priority: HIGHEST for action security_group_members [ 802.421035] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 802.421035] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473b7304-d562-4953-af3b-ac19b10b77b9 with Priority: HIGHEST for action security_group_members [ 802.421035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.421035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.421468] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-473b7304-d562-4953-af3b-ac19b10b77b9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.421468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.436057] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.436057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.436057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.436057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.436318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.436318] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 is going to be created. [ 802.460755] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.461050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.461050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.461304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.462033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.464687] env[62620]: INFO networking_nsxv3.common.synchronization [req-cb42b5b9-b630-4a6d-9cb1-6fa3f99ee08c req-95f9d232-b3f1-4e32-91f6-0bdf02394155 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_rules [ 802.464687] env[62620]: INFO networking_nsxv3.common.synchronization [req-cb42b5b9-b630-4a6d-9cb1-6fa3f99ee08c req-95f9d232-b3f1-4e32-91f6-0bdf02394155 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 802.464687] env[62620]: INFO networking_nsxv3.common.synchronization [req-cb42b5b9-b630-4a6d-9cb1-6fa3f99ee08c req-95f9d232-b3f1-4e32-91f6-0bdf02394155 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 with Priority: HIGHEST for action port [ 802.465123] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_rules [ 802.465574] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 802.465704] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 with Priority: HIGHEST for action port [ 802.466028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.466108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.466361] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.466466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.466629] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.466732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.466795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.466998] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.467092] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.471929] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 in Status: UNINITIALIZED for 2s [ 802.629321] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.631659] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('473b7304-d562-4953-af3b-ac19b10b77b9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.970455] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 with status ACTIVE [ 802.970455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.970455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.970455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.971073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.971073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.971073] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.971073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.971073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.971520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.971520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.971520] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.971777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.971777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.971777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.971982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.971982] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3 is going to be updated. [ 802.991813] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.991977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.992046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.992222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.992494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.992683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cb3b0a3-c2f5-4b36-a75a-b6d3b5e59dc3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.347650] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.347650] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 is going to be updated. [ 803.347650] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.347650] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 473b7304-d562-4953-af3b-ac19b10b77b9 is going to be created. [ 803.347650] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.347650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.349235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.349235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.349235] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.349235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.349235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.349235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.349235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.349235] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 473b7304-d562-4953-af3b-ac19b10b77b9 in Status: UNINITIALIZED for 2s [ 803.349235] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: IN_PROGRESS for 2s [ 804.330882] env[62620]: INFO networking_nsxv3.common.synchronization [req-7cbff2f5-6caa-476d-96f5-05191773e7f6 req-3c3b9d30-b299-4f08-995e-ccbff296f2ff tempest-ServersAdminTestJSON-158660873 tempest-ServersAdminTestJSON-158660873-project-member] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 804.332717] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 804.332717] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.332717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.332717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.333630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.333835] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.333979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.334087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.334312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.334700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.334852] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.481690] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 in Status: SUCCESS [ 804.481945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.482167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.482407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.482584] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.482703] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.482791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.482961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.483048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.483132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.483217] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.836967] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.991136] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.339867] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.346595] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 473b7304-d562-4953-af3b-ac19b10b77b9 in Status: SUCCESS [ 805.346952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.349021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.349021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.349021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.349021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.349021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.349021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.349021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.349021] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('473b7304-d562-4953-af3b-ac19b10b77b9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.350451] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: SUCCESS [ 805.350742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.351030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.351609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.351879] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.352118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.352263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.352562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.352845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.353047] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.361227] env[62620]: INFO networking_nsxv3.common.synchronization [req-d866bf92-8bfa-4630-9c60-2c8068361dd4 req-b8e9ef5d-1644-4586-a1ae-0d2f5a613cec tempest-FloatingIPsAssociationTestJSON-1435038635 tempest-FloatingIPsAssociationTestJSON-1435038635-project-member] Enqueued Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 805.361227] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 805.361227] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.361227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.361227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.361648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.361911] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.363733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.363733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.363733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.363733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.363733] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.389116] env[62620]: INFO networking_nsxv3.common.synchronization [req-2e38d84a-9513-4503-805a-6b92d68b7e43 req-dd0785d3-0fee-4543-80e5-4e015c24a231 tempest-ServersAdminNegativeTestJSON-337070548 tempest-ServersAdminNegativeTestJSON-337070548-project-member] Enqueued Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 805.389116] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGHEST for action security_group_members [ 805.389116] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.389116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.389116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.389685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.389999] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.390253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.391613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.391613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.391613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.391613] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.485763] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-427 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.485763] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.485970] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.486395] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.487036] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.487036] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.487171] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.487541] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.487724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.487970] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.488886] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.488886] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.488886] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.488886] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.488886] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.489139] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.493782] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f72e34a-6fab-4bd8-b5cb-722a902c51c1: rpc.has_security_group_logging(os_id): False [ 805.507685] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.507818] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.507962] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.508238] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.508798] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-85865adb-92d3-4f6e-a7af-6ddd191d13d3 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.509053] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-85865adb-92d3-4f6e-a7af-6ddd191d13d3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.509232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-85865adb-92d3-4f6e-a7af-6ddd191d13d3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.509625] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-85865adb-92d3-4f6e-a7af-6ddd191d13d3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.509795] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85865adb-92d3-4f6e-a7af-6ddd191d13d3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.511862] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.511979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.512063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.512261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.512429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.512685] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.512787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.512851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.513006] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.513094] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.513177] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 is going to be created. [ 805.568467] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.568687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.568802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.569060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.569251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.578831] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 in Status: IN_PROGRESS for 2s [ 805.842308] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.842741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.842844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.843095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.843193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.843309] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 805.855263] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.857280] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.857425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.857575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.857690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.857804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.857979] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.858089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.858161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.858357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.858477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.858652] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 473b7304-d562-4953-af3b-ac19b10b77b9 is going to be deleted. [ 805.865441] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.869102] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.869455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.869455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.869572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.869739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.878182] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 805.893516] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.893712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.893773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.894048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.894153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.894385] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.894534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.894593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.894768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.894844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.894930] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 is going to be updated. [ 805.897660] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.897836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.897897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.898243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.898349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.898420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.898622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.898994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.898994] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.899171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.899171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.899326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.899418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.899906] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('473b7304-d562-4953-af3b-ac19b10b77b9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.920722] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.920917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.920917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.921124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.921299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.937745] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: IN_PROGRESS for 2s [ 806.016414] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.016706] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.016872] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.017613] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.017818] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.018047] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 85865adb-92d3-4f6e-a7af-6ddd191d13d3 not found, creating... [ 806.018536] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.018676] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.018761] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.019500] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.019930] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.020452] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.024264] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.024451] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.024786] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.024968] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.025182] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 85865adb-92d3-4f6e-a7af-6ddd191d13d3 is going to be created. [ 806.049656] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.049929] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.050126] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.050498] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.050812] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.051132] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-85865adb-92d3-4f6e-a7af-6ddd191d13d3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.362616] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.367804] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.402525] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.402718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.402849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.404477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.404477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.404477] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.404477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.404477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.404477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.404477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.404874] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 473b7304-d562-4953-af3b-ac19b10b77b9 already deleted. [ 806.404874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.404874] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('473b7304-d562-4953-af3b-ac19b10b77b9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.406346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.406543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.406885] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.406997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.407070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.407230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.407306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.408178] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('473b7304-d562-4953-af3b-ac19b10b77b9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.874030] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.874030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.874030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.874030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.874030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.874030] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 is going to be updated. [ 806.874939] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.875286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.875382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.875568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.875647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.875744] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 is going to be updated. [ 806.904485] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.904641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.904713] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.904937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.905151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.907478] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.907670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.907725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.907931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.908097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.909673] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('473b7304-d562-4953-af3b-ac19b10b77b9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.914118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.914397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.914455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.915354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.915482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.915859] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.915979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.916061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.916249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.916336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.916472] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 473b7304-d562-4953-af3b-ac19b10b77b9 already deleted. [ 806.916532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.918928] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: IN_PROGRESS for 2s [ 806.919621] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: IN_PROGRESS for 2s [ 807.255656] env[62620]: INFO networking_nsxv3.common.synchronization [req-7cbff2f5-6caa-476d-96f5-05191773e7f6 req-f65a4e06-0cec-466f-9f70-fc57c7dc5203 service nova] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_rules [ 807.255872] env[62620]: INFO networking_nsxv3.common.synchronization [req-7cbff2f5-6caa-476d-96f5-05191773e7f6 req-f65a4e06-0cec-466f-9f70-fc57c7dc5203 service nova] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 807.256020] env[62620]: INFO networking_nsxv3.common.synchronization [req-7cbff2f5-6caa-476d-96f5-05191773e7f6 req-f65a4e06-0cec-466f-9f70-fc57c7dc5203 service nova] Enqueued Resource ID: 85865adb-92d3-4f6e-a7af-6ddd191d13d3 with Priority: HIGHEST for action port [ 807.259300] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_rules [ 807.259397] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 807.259501] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85865adb-92d3-4f6e-a7af-6ddd191d13d3 with Priority: HIGHEST for action port [ 807.259804] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.259929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.259996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.260278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.260374] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.261316] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.261419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.261895] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-85865adb-92d3-4f6e-a7af-6ddd191d13d3 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.262012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85865adb-92d3-4f6e-a7af-6ddd191d13d3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.264845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85865adb-92d3-4f6e-a7af-6ddd191d13d3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.265268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85865adb-92d3-4f6e-a7af-6ddd191d13d3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.265439] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85865adb-92d3-4f6e-a7af-6ddd191d13d3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.412944] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 473b7304-d562-4953-af3b-ac19b10b77b9: rpc.has_security_group_logging(os_id): False [ 807.435018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.435018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.435018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.435018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.435018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.435018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.435018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.435018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.435018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.435018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.435018] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 473b7304-d562-4953-af3b-ac19b10b77b9 is going to be created. [ 807.452870] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/473b7304-d562-4953-af3b-ac19b10b77b9], does not exist path=[/infra/domains/default/groups/473b7304-d562-4953-af3b-ac19b10b77b9]."\n}' [ 807.452870] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 473b7304-d562-4953-af3b-ac19b10b77b9 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/473b7304-d562-4953-af3b-ac19b10b77b9 [ 807.452870] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 807.478238] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.478238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.478238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.478238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.479269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.479751] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.480071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.480697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.480697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.480697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.481440] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.481440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.481440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.481613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.482390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.482390] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 473b7304-d562-4953-af3b-ac19b10b77b9 is going to be created. [ 807.497463] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/473b7304-d562-4953-af3b-ac19b10b77b9], does not exist path=[/infra/domains/default/groups/473b7304-d562-4953-af3b-ac19b10b77b9]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/473b7304-d562-4953-af3b-ac19b10b77b9 [ 807.497647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-473b7304-d562-4953-af3b-ac19b10b77b9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.498242] env[62620]: Traceback (most recent call last): [ 807.498296] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 807.498296] env[62620]: return func(*args, **kwargs) [ 807.498296] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 807.498296] env[62620]: res.raise_for_status() [ 807.498296] env[62620]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 807.498296] env[62620]: raise HTTPError(http_error_msg, response=self) [ 807.498296] env[62620]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/473b7304-d562-4953-af3b-ac19b10b77b9 [ 807.498296] env[62620]: During handling of the above exception, another exception occurred: [ 807.498296] env[62620]: Traceback (most recent call last): [ 807.498296] env[62620]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 807.498296] env[62620]: listener.cb(fileno) [ 807.498296] env[62620]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 807.498296] env[62620]: result = function(*args, **kwargs) [ 807.498296] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 807.498296] env[62620]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 807.498296] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 807.498296] env[62620]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 807.498296] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 807.498296] env[62620]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 807.498296] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 807.498296] env[62620]: res.raise_for_status() [ 807.498296] env[62620]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 807.498296] env[62620]: raise HTTPError(http_error_msg, response=self) [ 807.498879] env[62620]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/473b7304-d562-4953-af3b-ac19b10b77b9 [ 807.498879] env[62620]: Removing descriptor: 21 [ 807.592967] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 in Status: SUCCESS [ 807.593252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.767761] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.767761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.767761] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85865adb-92d3-4f6e-a7af-6ddd191d13d3 with status ACTIVE [ 807.767761] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.768965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.769533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.769816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.770310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.770585] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.771066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.771408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.772233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.772884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.772884] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.772884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.772884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.772884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.773983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.774144] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85865adb-92d3-4f6e-a7af-6ddd191d13d3 is going to be updated. [ 807.793793] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.793868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.793938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.794164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.794297] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.794458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85865adb-92d3-4f6e-a7af-6ddd191d13d3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.897020] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 807.897020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.897020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.897020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.897020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.897020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.897020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.897020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.897020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.897020] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.949548] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 in Status: SUCCESS [ 807.949734] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 deletion is rescheduled due to dependency. [ 807.949849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.398394] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.902230] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.931297] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: SUCCESS [ 808.931297] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.935178] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: SUCCESS [ 808.935395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.936100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.936100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.936100] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.936100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.936277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.936318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.936400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.936484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.937349] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.938880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.939205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.939381] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.939489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.939551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.939695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.940344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.940344] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.012783] env[62620]: INFO networking_nsxv3.common.synchronization [None req-44997d86-366a-4182-a06c-46c6d67887f1 tempest-MigrationsAdminTest-1384528618 tempest-MigrationsAdminTest-1384528618-project-member] Enqueued Resource ID: d5b4fa72-9120-42a6-a446-8f993b668973 with Priority: HIGHEST for action security_group_rules [ 809.013385] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b4fa72-9120-42a6-a446-8f993b668973 with Priority: HIGHEST for action security_group_rules [ 809.013752] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5b4fa72-9120-42a6-a446-8f993b668973 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.013883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5b4fa72-9120-42a6-a446-8f993b668973" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.013951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5b4fa72-9120-42a6-a446-8f993b668973" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.014307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5b4fa72-9120-42a6-a446-8f993b668973" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.014457] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5b4fa72-9120-42a6-a446-8f993b668973',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.118901] env[62620]: INFO networking_nsxv3.common.synchronization [None req-2dd4f335-4512-4747-a3fb-e31884d5e97d tempest-MigrationsAdminTest-1384528618 tempest-MigrationsAdminTest-1384528618-project-member] Enqueued Resource ID: d5b4fa72-9120-42a6-a446-8f993b668973 with Priority: HIGHEST for action security_group_rules [ 809.119441] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b4fa72-9120-42a6-a446-8f993b668973 with Priority: HIGHEST for action security_group_rules [ 809.119825] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5b4fa72-9120-42a6-a446-8f993b668973 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.119922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5b4fa72-9120-42a6-a446-8f993b668973" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.410671] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.410762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.410825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.411191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.411420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.413015] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 809.441473] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.441724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.441819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.442088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.442285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.443552] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.444089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.444355] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.454531] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 809.536171] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.536171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.536171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.536171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.536171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.536171] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5b4fa72-9120-42a6-a446-8f993b668973 already deleted. [ 809.536171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5b4fa72-9120-42a6-a446-8f993b668973" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.536171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5b4fa72-9120-42a6-a446-8f993b668973" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.536171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5b4fa72-9120-42a6-a446-8f993b668973" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.536171] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5b4fa72-9120-42a6-a446-8f993b668973',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.799336] env[62620]: INFO networking_nsxv3.common.synchronization [req-a76a3021-e9f2-477c-ad21-6987fce750ab req-4bdd8fe8-389e-4847-b1b9-6d621a3f21dc tempest-ImagesOneServerTestJSON-1340245844 tempest-ImagesOneServerTestJSON-1340245844-project-member] Enqueued Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGHEST for action security_group_members [ 809.801406] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGHEST for action security_group_members [ 809.802853] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84776719-6313-41bf-88fe-129baf34c6ed taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.802973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.803048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.803554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.804371] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.804371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.804371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.804613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.804725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.804833] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84776719-6313-41bf-88fe-129baf34c6ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.949527] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.058975] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.058975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.058975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.058975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.058975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.058975] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5b4fa72-9120-42a6-a446-8f993b668973 already deleted. [ 810.058975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5b4fa72-9120-42a6-a446-8f993b668973" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.307622] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.309706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.309706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.309706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.309706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.309706] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.309706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.309706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.309706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.309706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.309706] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84776719-6313-41bf-88fe-129baf34c6ed already deleted. [ 810.309706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.451488] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.451805] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-994" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.451887] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-994" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.453657] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-994" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.453972] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.454168] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.454966] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.455271] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.455507] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.455694] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.455818] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.455982] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.456056] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.456188] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.456302] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.456455] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.458429] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.458429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.458429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.458610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.459383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.459383] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 is going to be updated. [ 810.486450] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.486727] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 810.487064] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.487132] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-994" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.487462] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-bb608229-71bb-45a8-8815-5bb1cda6c5b0 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.487709] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-bb608229-71bb-45a8-8815-5bb1cda6c5b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.487757] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-bb608229-71bb-45a8-8815-5bb1cda6c5b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.488617] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-bb608229-71bb-45a8-8815-5bb1cda6c5b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.488841] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb608229-71bb-45a8-8815-5bb1cda6c5b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.498883] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.499039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.499569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.499569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.499569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.508400] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: IN_PROGRESS for 2s [ 810.995062] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.995568] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.995568] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.995772] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.995970] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.996838] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port bb608229-71bb-45a8-8815-5bb1cda6c5b0 not found, creating... [ 810.996838] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.996838] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.996838] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.997224] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.997347] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.997682] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.997860] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.998580] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.998580] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.998580] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.998743] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: bb608229-71bb-45a8-8815-5bb1cda6c5b0 is going to be created. [ 811.019759] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.020021] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.020140] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.020462] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.020643] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.020861] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-bb608229-71bb-45a8-8815-5bb1cda6c5b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.463819] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 811.464022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.464200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.464416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.464659] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.464836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.464931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.465120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.465205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.465291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.465381] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.720518] env[62620]: INFO networking_nsxv3.common.synchronization [req-a76a3021-e9f2-477c-ad21-6987fce750ab req-b43b6d98-721d-4fcf-b6f3-47efd749a5fe service nova] Enqueued Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGHEST for action security_group_rules [ 811.720518] env[62620]: INFO networking_nsxv3.common.synchronization [req-a76a3021-e9f2-477c-ad21-6987fce750ab req-b43b6d98-721d-4fcf-b6f3-47efd749a5fe service nova] Enqueued Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGHEST for action security_group_members [ 811.720518] env[62620]: INFO networking_nsxv3.common.synchronization [req-a76a3021-e9f2-477c-ad21-6987fce750ab req-b43b6d98-721d-4fcf-b6f3-47efd749a5fe service nova] Enqueued Resource ID: bb608229-71bb-45a8-8815-5bb1cda6c5b0 with Priority: HIGHEST for action port [ 811.720518] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGHEST for action security_group_rules [ 811.720518] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGHEST for action security_group_members [ 811.720518] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb608229-71bb-45a8-8815-5bb1cda6c5b0 with Priority: HIGHEST for action port [ 811.720518] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84776719-6313-41bf-88fe-129baf34c6ed taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.720518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.720518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.724156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.724156] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84776719-6313-41bf-88fe-129baf34c6ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.724156] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84776719-6313-41bf-88fe-129baf34c6ed taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.724156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.724156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.724156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.724156] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.724156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.724156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.724156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.724800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.725072] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84776719-6313-41bf-88fe-129baf34c6ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.728417] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb608229-71bb-45a8-8815-5bb1cda6c5b0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.728567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb608229-71bb-45a8-8815-5bb1cda6c5b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.729385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb608229-71bb-45a8-8815-5bb1cda6c5b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.729385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb608229-71bb-45a8-8815-5bb1cda6c5b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.729385] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb608229-71bb-45a8-8815-5bb1cda6c5b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.969320] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.969496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.969496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.969730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.969895] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.970054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.970118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.970271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.970564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.970564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.970728] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.970728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.970806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.970919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.971117] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.971205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.971266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.971403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.971480] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.971564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.971654] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.231069] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84776719-6313-41bf-88fe-129baf34c6ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.232637] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84776719-6313-41bf-88fe-129baf34c6ed taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.232766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.234746] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb608229-71bb-45a8-8815-5bb1cda6c5b0 with status ACTIVE [ 812.234990] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.235134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.235207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.235424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.235531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.235709] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.235851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.235919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.236087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.237908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.237908] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.237908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.237908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.237908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.237908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.237908] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb608229-71bb-45a8-8815-5bb1cda6c5b0 is going to be updated. [ 812.260113] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.260273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.260347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.260548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.260678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.261174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb608229-71bb-45a8-8815-5bb1cda6c5b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.313550] env[62620]: INFO networking_nsxv3.common.synchronization [req-03afe6a7-56ac-4412-a977-1ae075768e01 req-0720496e-53ae-472f-a953-2050c4995938 tempest-ServerRescueTestJSONUnderV235-139392927 tempest-ServerRescueTestJSONUnderV235-139392927-project-member] Enqueued Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 812.314260] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cad687-b90b-448c-be96-2ad4dc207d55 with Priority: HIGHEST for action security_group_members [ 812.314920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.315077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.477701] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b140e556-13f7-4e22-a7d6-53ddc3943100: rpc.has_security_group_logging(os_id): False [ 812.495194] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.495194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.495194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.495194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.515247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.515247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.515247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.515247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.516205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.516205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.516205] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 812.517476] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: SUCCESS [ 812.517570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.518243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.518243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.518243] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.518243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.518243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.518454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.518454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.518507] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.572172] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.572306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.572379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.572699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.572896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.585035] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 812.606972] env[62620]: INFO networking_nsxv3.common.synchronization [req-005b4c84-2d30-4fb5-b4d3-368c1e7ef9cc req-6a9ce41e-d1ca-4a82-97b3-a7cf8c0a734c tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 812.607584] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 812.607964] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.608470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.608611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.608949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.609184] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.609323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.609410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.609609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.609723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.609848] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.738728] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84776719-6313-41bf-88fe-129baf34c6ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.021475] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.021781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.021891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.022156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.041334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.041645] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.041770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.041835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.042169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.042246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.042343] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 is going to be updated. [ 813.069341] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.069471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.069544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.069742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.069887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.079245] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: IN_PROGRESS for 2s [ 813.112957] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.113165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.113236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.113588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.113664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.113839] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.113955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.114050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.114221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.114301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.114405] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 already deleted. [ 813.114470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.240863] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.241232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.241232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.241326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.241403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.241526] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84776719-6313-41bf-88fe-129baf34c6ed is going to be created. [ 813.270383] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.270567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.270650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.270868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.271038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.280397] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84776719-6313-41bf-88fe-129baf34c6ed in Status: UNINITIALIZED for 2s [ 813.754676] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.754952] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.755180] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.755622] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.756024] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.759663] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.759663] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.759780] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.760141] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.760252] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.760378] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.760498] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.760659] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.761177] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.761177] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.761177] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.786789] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.786789] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 813.786789] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.786789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.786789] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.786789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.787066] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.787229] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.787374] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc1db27a-489e-4bc7-a90d-1af91c74e4fd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.805087] env[62620]: INFO networking_nsxv3.common.synchronization [req-a8b199b3-718d-4962-b925-ffcb4ce76c7b req-d843248d-3a70-4216-9192-aa6a32fa5447 tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 813.805576] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 813.806285] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.806631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.806631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.806727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.806841] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.806941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.807017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.807167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.807251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.807360] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.290172] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.290503] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.290649] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.290982] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.291189] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.291380] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port fc1db27a-489e-4bc7-a90d-1af91c74e4fd not found, creating... [ 814.291714] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.291901] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.292036] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.292269] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.292413] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.292731] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.292906] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.293071] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.293354] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.293548] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.293725] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: fc1db27a-489e-4bc7-a90d-1af91c74e4fd is going to be created. [ 814.309762] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.309918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.310035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.310209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.318609] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.318797] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.318925] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.319196] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.319423] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.319701] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.330952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.331315] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.331927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.331927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.331927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.332104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.332216] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 814.357698] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.357841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.357921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.358159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.358356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.366799] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 814.599271] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 814.599422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.081902] env[62620]: INFO networking_nsxv3.common.synchronization [req-005b4c84-2d30-4fb5-b4d3-368c1e7ef9cc req-4cd8ed9e-569c-4f93-bffb-aa1005fe8195 service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 815.082097] env[62620]: INFO networking_nsxv3.common.synchronization [req-005b4c84-2d30-4fb5-b4d3-368c1e7ef9cc req-4cd8ed9e-569c-4f93-bffb-aa1005fe8195 service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 815.082238] env[62620]: INFO networking_nsxv3.common.synchronization [req-005b4c84-2d30-4fb5-b4d3-368c1e7ef9cc req-4cd8ed9e-569c-4f93-bffb-aa1005fe8195 service nova] Enqueued Resource ID: fc1db27a-489e-4bc7-a90d-1af91c74e4fd with Priority: HIGHEST for action port [ 815.082741] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 815.082875] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 815.082974] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc1db27a-489e-4bc7-a90d-1af91c74e4fd with Priority: HIGHEST for action port [ 815.086060] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.086192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.086261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.086525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.086611] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.090883] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.090883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.090883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.091092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.092601] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.092601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.092601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.092601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.092601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.092601] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.093030] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.093030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.093030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.094220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.094309] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc1db27a-489e-4bc7-a90d-1af91c74e4fd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.096341] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: SUCCESS [ 815.096460] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 deletion is rescheduled due to dependency. [ 815.096561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.096877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.097165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.097223] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.097318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.097392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.097602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.097650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.097704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.097966] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17cad687-b90b-448c-be96-2ad4dc207d55 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.097966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.098072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.098169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.098359] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.098416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.098445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.098578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.099324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.099324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.099324] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.099716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.099791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.099938] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.100047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.100111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.100244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.100320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.100413] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.292543] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84776719-6313-41bf-88fe-129baf34c6ed in Status: SUCCESS [ 815.292818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.292915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.293160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.293351] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.293517] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.293618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.293744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.293826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.293911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.294086] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84776719-6313-41bf-88fe-129baf34c6ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.596081] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.597267] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.597267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.600466] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc1db27a-489e-4bc7-a90d-1af91c74e4fd with status ACTIVE [ 815.600466] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.600590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.600590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.601542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.601542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.601542] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.601542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.601542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.601542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.601542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.601798] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.601798] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.601798] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.601899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.601995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.602101] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc1db27a-489e-4bc7-a90d-1af91c74e4fd is going to be updated. [ 815.603137] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17cad687-b90b-448c-be96-2ad4dc207d55: rpc.has_security_group_logging(os_id): False [ 815.604110] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.604954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.604954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.604954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.604954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.604954] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.604954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.604954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.604954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.605272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.605272] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 is going to be updated. [ 815.626210] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.626360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.626409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.626651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.626756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.626952] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.627084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.627149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.627308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.627431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.627579] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.627673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.627741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.627920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.627999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.628366] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.628441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.628476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.628592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.628667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.628749] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 is going to be updated. [ 815.630438] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.630553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.630641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.630798] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.630922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.631085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc1db27a-489e-4bc7-a90d-1af91c74e4fd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.641424] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.641659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.641751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.641964] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.642159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.652997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: IN_PROGRESS for 2s [ 815.740130] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.740130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.740130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.740130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.740130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.755991] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: IN_PROGRESS for 2s [ 815.797034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84776719-6313-41bf-88fe-129baf34c6ed taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.797034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.797034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.797243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.797356] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.797468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.797532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.797701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.797794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.797885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.798045] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84776719-6313-41bf-88fe-129baf34c6ed taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.798147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.798208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.798353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.798496] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.798587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.798768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.798884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.798884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.798940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.799040] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84776719-6313-41bf-88fe-129baf34c6ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.100881] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.266361] env[62620]: INFO networking_nsxv3.common.synchronization [req-67de70ee-4c60-4bcd-83d0-fc3442cb61fc req-d3be4de4-6f93-4c1b-bcd7-98165b78a81f tempest-AttachInterfacesV270Test-1651543906 tempest-AttachInterfacesV270Test-1651543906-project-member] Enqueued Resource ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd with Priority: HIGHEST for action security_group_members [ 816.266361] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd with Priority: HIGHEST for action security_group_members [ 816.266361] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.266591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.266591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.270021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.270021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.270021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.270021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.270021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.270021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.270021] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2bbf04f-3b75-4f98-a58c-b7dfe66747dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.301697] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84776719-6313-41bf-88fe-129baf34c6ed: rpc.has_security_group_logging(os_id): False [ 816.321860] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.322020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.322095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.322329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.322422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.322609] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.322715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.322768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.322924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.322997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.323214] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.323313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.323375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.323546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.323654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.323847] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.323944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.324023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.324376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.324455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.324563] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84776719-6313-41bf-88fe-129baf34c6ed is going to be created. [ 816.375234] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 816.375429] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 deletion is rescheduled due to dependency. [ 816.375555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.383311] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.383442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.383442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.383695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.383884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.394116] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84776719-6313-41bf-88fe-129baf34c6ed in Status: IN_PROGRESS for 2s [ 816.603924] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.604125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.604184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.604408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.604518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.604620] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be created. [ 816.631526] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.631526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.631526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.631782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.631872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.640772] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: UNINITIALIZED for 2s [ 816.717302] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.717509] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-974" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.717638] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-974" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.718232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-974" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.718508] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.718674] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.718796] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.719028] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.720032] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.720032] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.720032] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.720032] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.720032] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.720032] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.720310] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.720310] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.738256] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.738420] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.738559] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.738731] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-974" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.739031] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-d126d7bd-d076-4411-8929-af4270455b6d taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.739202] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-d126d7bd-d076-4411-8929-af4270455b6d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.739324] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-d126d7bd-d076-4411-8929-af4270455b6d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.739609] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-d126d7bd-d076-4411-8929-af4270455b6d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.739752] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d126d7bd-d076-4411-8929-af4270455b6d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.771034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.771034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.771034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.771217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.771217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.771444] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.771562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.771627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.771780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.771856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.771939] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd already deleted. [ 816.772055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.243922] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.244165] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.244298] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.244600] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.244784] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.244987] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port d126d7bd-d076-4411-8929-af4270455b6d not found, creating... [ 817.246145] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.246145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.246145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.246145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.246145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.246358] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.246540] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.246661] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.246902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.247062] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.247208] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: d126d7bd-d076-4411-8929-af4270455b6d is going to be created. [ 817.267134] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.267356] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.267489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.267786] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.268055] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.268290] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-d126d7bd-d076-4411-8929-af4270455b6d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.661714] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: SUCCESS [ 817.661964] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 deletion is rescheduled due to dependency. [ 817.662047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.768717] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17cad687-b90b-448c-be96-2ad4dc207d55 in Status: SUCCESS [ 817.768971] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.769172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.769410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.769502] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17cad687-b90b-448c-be96-2ad4dc207d55',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.067513] env[62620]: INFO networking_nsxv3.common.synchronization [req-67de70ee-4c60-4bcd-83d0-fc3442cb61fc req-acc80fd5-0820-4bd6-bdd1-1b11963d34a2 service nova] Enqueued Resource ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd with Priority: HIGHEST for action security_group_rules [ 818.067700] env[62620]: INFO networking_nsxv3.common.synchronization [req-67de70ee-4c60-4bcd-83d0-fc3442cb61fc req-acc80fd5-0820-4bd6-bdd1-1b11963d34a2 service nova] Enqueued Resource ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd with Priority: HIGHEST for action security_group_members [ 818.068257] env[62620]: INFO networking_nsxv3.common.synchronization [req-67de70ee-4c60-4bcd-83d0-fc3442cb61fc req-acc80fd5-0820-4bd6-bdd1-1b11963d34a2 service nova] Enqueued Resource ID: d126d7bd-d076-4411-8929-af4270455b6d with Priority: HIGHEST for action port [ 818.068257] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd with Priority: HIGHEST for action security_group_rules [ 818.068257] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd with Priority: HIGHEST for action security_group_members [ 818.068368] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d126d7bd-d076-4411-8929-af4270455b6d with Priority: HIGHEST for action port [ 818.068835] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.068961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.069238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.069568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.069656] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2bbf04f-3b75-4f98-a58c-b7dfe66747dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.070454] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.070572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.070626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.070784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.070927] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.071031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.071097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.071239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.071324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.071413] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2bbf04f-3b75-4f98-a58c-b7dfe66747dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.072104] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-d126d7bd-d076-4411-8929-af4270455b6d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.072208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d126d7bd-d076-4411-8929-af4270455b6d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.072271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d126d7bd-d076-4411-8929-af4270455b6d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.072416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d126d7bd-d076-4411-8929-af4270455b6d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.072483] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d126d7bd-d076-4411-8929-af4270455b6d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.293174] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.293339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.293603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.293690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.293836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.293944] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17cad687-b90b-448c-be96-2ad4dc207d55 is going to be deleted. [ 818.345108] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.345384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.345384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.345552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.345648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.345880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17cad687-b90b-448c-be96-2ad4dc207d55" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.408460] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84776719-6313-41bf-88fe-129baf34c6ed in Status: SUCCESS [ 818.408460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.576146] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.576278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.577427] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2bbf04f-3b75-4f98-a58c-b7dfe66747dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.577427] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d126d7bd-d076-4411-8929-af4270455b6d with status ACTIVE [ 818.577578] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.577680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.577745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.577951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.583393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.583393] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.583393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.583393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.583633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.586478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.586478] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.586585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.586585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.587813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.587813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.587813] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d126d7bd-d076-4411-8929-af4270455b6d is going to be updated. [ 818.607928] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.608151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.608192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.608365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.608503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.608665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d126d7bd-d076-4411-8929-af4270455b6d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.650281] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 818.650494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.650657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.650862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.651058] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.651174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.651246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.651626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.651747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.651839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.652155] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.089891] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2bbf04f-3b75-4f98-a58c-b7dfe66747dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.154084] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.154229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.154336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.154762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.154762] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.155029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.155029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.155029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.155347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.155347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.155503] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.156073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.156073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.156073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.156073] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.156380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.156380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.156380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.156461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.156640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.156640] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.594206] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.594206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.594206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.594206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.594206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.594206] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd is going to be created. [ 819.616924] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.617210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.617210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.617504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.617667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.626744] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd in Status: UNINITIALIZED for 2s [ 819.659347] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c469d6d-346a-40a2-adb5-8c50f7758224: rpc.has_security_group_logging(os_id): False [ 819.677496] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.677622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.677695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.678014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.678104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.678308] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.678408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.678468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.678637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.678709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.678904] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.678992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.679063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.679202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.679550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.679550] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.679550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.679694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.679726] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.679769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.679854] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be created. [ 819.736214] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.736214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.736214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.736214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.736214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.745202] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 820.763906] env[62620]: INFO networking_nsxv3.common.synchronization [None req-fe8b37fb-1770-40aa-894d-62fd99ec13b1 None None] Enqueued Resource ID: 8f2dae97-107d-4123-8cb7-135dcb456d06 with Priority: HIGHEST for action port [ 820.764242] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f2dae97-107d-4123-8cb7-135dcb456d06 with Priority: HIGHEST for action port [ 820.764720] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f2dae97-107d-4123-8cb7-135dcb456d06 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.764845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f2dae97-107d-4123-8cb7-135dcb456d06" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.764913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f2dae97-107d-4123-8cb7-135dcb456d06" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.766728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f2dae97-107d-4123-8cb7-135dcb456d06" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.766728] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f2dae97-107d-4123-8cb7-135dcb456d06',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.272702] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f2dae97-107d-4123-8cb7-135dcb456d06 [ 821.272858] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.273035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.273154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.273591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.273591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.273717] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f2dae97-107d-4123-8cb7-135dcb456d06 already deleted. [ 821.273762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f2dae97-107d-4123-8cb7-135dcb456d06" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.288492] env[62620]: INFO networking_nsxv3.common.synchronization [req-87da9a5d-3b3c-49e7-8b20-261630332a0d req-dbc2cb62-4491-4701-8031-5dd35981fd6a tempest-DeleteServersAdminTestJSON-1615940801 tempest-DeleteServersAdminTestJSON-1615940801-project-member] Enqueued Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 821.288670] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 821.288972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.289225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.289225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.291822] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.293028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.293028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.293410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.293410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.293410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.293497] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.639852] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd in Status: SUCCESS [ 821.639852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.639852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.639852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.639852] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.639852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.639852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.639852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.639852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.639852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.639852] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2bbf04f-3b75-4f98-a58c-b7dfe66747dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.688453] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.688714] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.688896] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.689231] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.689529] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.689825] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.689999] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.690264] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.690454] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.690856] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.690967] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.691194] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.691319] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.691436] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.691549] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.691682] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.714124] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.714315] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.714592] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.714729] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.715165] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-3b9cf75c-dd86-44d1-9123-1680cabc589d taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.715361] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-3b9cf75c-dd86-44d1-9123-1680cabc589d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.715486] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-3b9cf75c-dd86-44d1-9123-1680cabc589d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.717000] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-3b9cf75c-dd86-44d1-9123-1680cabc589d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.717000] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9cf75c-dd86-44d1-9123-1680cabc589d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.756981] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 821.757179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.795951] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.796308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.796308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.796430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.819468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.819468] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.819626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.819698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.819899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.819953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.820243] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 is going to be updated. [ 821.843902] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.843902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.843902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.844202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.844314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.852563] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: IN_PROGRESS for 2s [ 822.142690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.143008] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.143171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.143474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.143794] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.144037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.144252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.144508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.144705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.144973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.145220] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.145418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.145547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.145776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.146078] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.146278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.146542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.146768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.146937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.147110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.147279] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2bbf04f-3b75-4f98-a58c-b7dfe66747dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.219772] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.220530] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.220530] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.222526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.222526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.222526] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 3b9cf75c-dd86-44d1-9123-1680cabc589d not found, creating... [ 822.222526] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.222526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.222526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.222526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.222526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.222526] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.222526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.223436] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.223436] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.223436] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.223436] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 3b9cf75c-dd86-44d1-9123-1680cabc589d is going to be created. [ 822.247643] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.248111] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.248345] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.248684] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.249107] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.249475] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-3b9cf75c-dd86-44d1-9123-1680cabc589d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.649927] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2bbf04f-3b75-4f98-a58c-b7dfe66747dd: rpc.has_security_group_logging(os_id): False [ 822.670546] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.670686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.670761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.670973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.671083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.671279] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.671379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.671455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.671766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.671927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.672194] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.672289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.672348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.672502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.672555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.672776] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.672874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.672932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.673078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.673148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.673230] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd is going to be created. [ 822.733887] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.734045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.734101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.734325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.734509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.748841] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd in Status: IN_PROGRESS for 2s [ 823.061027] env[62620]: INFO networking_nsxv3.common.synchronization [req-87da9a5d-3b3c-49e7-8b20-261630332a0d req-ecf706d1-8141-402e-8999-ff39b6a5c3cf service nova] Enqueued Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_rules [ 823.061261] env[62620]: INFO networking_nsxv3.common.synchronization [req-87da9a5d-3b3c-49e7-8b20-261630332a0d req-ecf706d1-8141-402e-8999-ff39b6a5c3cf service nova] Enqueued Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 823.061293] env[62620]: INFO networking_nsxv3.common.synchronization [req-87da9a5d-3b3c-49e7-8b20-261630332a0d req-ecf706d1-8141-402e-8999-ff39b6a5c3cf service nova] Enqueued Resource ID: 3b9cf75c-dd86-44d1-9123-1680cabc589d with Priority: HIGHEST for action port [ 823.061661] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_rules [ 823.061661] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 823.061773] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b9cf75c-dd86-44d1-9123-1680cabc589d with Priority: HIGHEST for action port [ 823.062382] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.062579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.062579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.062692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.062759] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.065090] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.065202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.065372] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b9cf75c-dd86-44d1-9123-1680cabc589d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.065467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b9cf75c-dd86-44d1-9123-1680cabc589d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.065521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b9cf75c-dd86-44d1-9123-1680cabc589d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.065715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b9cf75c-dd86-44d1-9123-1680cabc589d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.066116] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9cf75c-dd86-44d1-9123-1680cabc589d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.195381] env[62620]: INFO networking_nsxv3.common.synchronization [None req-be31524b-df8d-4cb6-815e-16b33e7f0378 None None] Enqueued Resource ID: 8d821165-a230-49d7-a514-1d9f7199bc4f with Priority: HIGHEST for action port [ 823.195651] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d821165-a230-49d7-a514-1d9f7199bc4f with Priority: HIGHEST for action port [ 823.196295] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d821165-a230-49d7-a514-1d9f7199bc4f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.196427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d821165-a230-49d7-a514-1d9f7199bc4f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.196493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d821165-a230-49d7-a514-1d9f7199bc4f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.196766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d821165-a230-49d7-a514-1d9f7199bc4f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.196874] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d821165-a230-49d7-a514-1d9f7199bc4f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.572429] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b9cf75c-dd86-44d1-9123-1680cabc589d with status ACTIVE [ 823.572429] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.572429] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.572429] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.572429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.572429] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b9cf75c-dd86-44d1-9123-1680cabc589d is going to be updated. [ 823.573235] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.573389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.594949] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.594949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.594949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.594949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.594949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.594949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b9cf75c-dd86-44d1-9123-1680cabc589d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.701269] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d821165-a230-49d7-a514-1d9f7199bc4f [ 823.701269] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.701269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.701269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.701269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.701269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.701269] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d821165-a230-49d7-a514-1d9f7199bc4f already deleted. [ 823.701269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d821165-a230-49d7-a514-1d9f7199bc4f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.865615] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: SUCCESS [ 823.866235] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 deletion is rescheduled due to dependency. [ 823.866235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.866235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.866391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.866549] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.867170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.867170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.867170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.867170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.867170] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.370421] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.760036] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd in Status: SUCCESS [ 824.760413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.876016] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.377864] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.379659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.379659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.379659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.379659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.379659] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 is going to be updated. [ 825.406582] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.406688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.406814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.406956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.407151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.415434] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: IN_PROGRESS for 2s [ 825.541405] env[62620]: INFO networking_nsxv3.common.synchronization [req-7ed47f54-b821-49b1-85ff-7988a25704ef req-014cd8fe-5adf-4ea6-9453-31ae68e9becc tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 825.541405] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 825.541405] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.541405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.541405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.541868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.542045] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.542151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.542215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.542370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.543026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.543026] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.044547] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.044754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.044830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.045084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.045183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.045388] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.045487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.045550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.045705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.045784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.045869] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 826.070709] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.070709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.070910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.070942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.071090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.079839] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 827.424987] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: SUCCESS [ 827.424987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.424987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.425378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.425378] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.425479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.425548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.425706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.425792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.425880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.425974] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.479878] env[62620]: INFO networking_nsxv3.common.synchronization [req-b0944d6b-31bb-49d4-b0a5-05b5dc53a97e req-973e80f6-f3bb-42b8-8a6c-a97527b06fc3 tempest-ServerRescueNegativeTestJSON-1339547319 tempest-ServerRescueNegativeTestJSON-1339547319-project-member] Enqueued Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 827.480659] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 827.481226] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.481226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.481226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.486248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.486474] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.486605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.486675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.486860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.486952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.487080] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.928980] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.929251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.929364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.929621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.929812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.929914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.929979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.930144] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.930314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.930429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.930599] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.930696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.930757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.930898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.931078] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.931189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.931261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.931434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.931532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.931623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.931710] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.990673] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.990673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.990673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.990673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.990673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.990673] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.990673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.990673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.990673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.990673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.990673] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 already deleted. [ 827.990673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.089898] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 828.091727] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 828.091854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.181620] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.181927] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.182080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.182413] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.182680] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.182832] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.182947] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.183273] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.183456] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.183711] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.183827] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.183940] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.184063] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.184204] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.184315] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.184449] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.206320] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.206538] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.206689] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.206882] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.207362] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-ddd3e21b-1460-4da2-bfcc-258303d2719e taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.207429] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-ddd3e21b-1460-4da2-bfcc-258303d2719e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.208232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-ddd3e21b-1460-4da2-bfcc-258303d2719e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.208232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-ddd3e21b-1460-4da2-bfcc-258303d2719e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.208232] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd3e21b-1460-4da2-bfcc-258303d2719e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.337042] env[62620]: INFO networking_nsxv3.common.synchronization [req-cc6eb1f9-32f9-485d-9db7-a375a64b1299 req-8abbdf7c-115d-4239-a84e-18f27ece9c6a tempest-ListServersNegativeTestJSON-1492694773 tempest-ListServersNegativeTestJSON-1492694773-project-member] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 828.337522] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 828.337850] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.337975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.339031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.339031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.339031] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.339031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.339031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.339031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.339031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.339031] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.436264] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7027a4f2-13d4-467a-96da-8c378fa8ac69: rpc.has_security_group_logging(os_id): False [ 828.454048] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.454048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.454253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.454323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.454416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.454720] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.454836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.454901] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.455070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.455151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.455336] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.455430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.455493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.455632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.455709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.455924] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.456061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.456061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.456325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.456325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.456413] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 is going to be updated. [ 828.517430] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.517619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.517690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.517861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.518019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.528897] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: IN_PROGRESS for 2s [ 828.711158] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.711350] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.711491] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.711861] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.712115] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.712313] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port ddd3e21b-1460-4da2-bfcc-258303d2719e not found, creating... [ 828.712864] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.713169] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.713241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.713681] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.713814] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.714356] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.714640] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.714717] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.715022] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.715145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.715263] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: ddd3e21b-1460-4da2-bfcc-258303d2719e is going to be created. [ 828.735465] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.735986] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.735986] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.736329] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.736463] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.736603] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-ddd3e21b-1460-4da2-bfcc-258303d2719e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.841247] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.343234] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.562631] env[62620]: INFO networking_nsxv3.common.synchronization [req-b0944d6b-31bb-49d4-b0a5-05b5dc53a97e req-e2fe5ef6-15ea-4a6a-95d1-4ae83192284c service nova] Enqueued Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_rules [ 829.562882] env[62620]: INFO networking_nsxv3.common.synchronization [req-b0944d6b-31bb-49d4-b0a5-05b5dc53a97e req-e2fe5ef6-15ea-4a6a-95d1-4ae83192284c service nova] Enqueued Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 829.562956] env[62620]: INFO networking_nsxv3.common.synchronization [req-b0944d6b-31bb-49d4-b0a5-05b5dc53a97e req-e2fe5ef6-15ea-4a6a-95d1-4ae83192284c service nova] Enqueued Resource ID: ddd3e21b-1460-4da2-bfcc-258303d2719e with Priority: HIGHEST for action port [ 829.563203] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_rules [ 829.563369] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 829.563479] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd3e21b-1460-4da2-bfcc-258303d2719e with Priority: HIGHEST for action port [ 829.564351] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.564528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.564640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.564942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.565065] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.568808] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.568808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.568808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.568808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.568808] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.568808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.568808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.568808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.568808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.568808] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.570991] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd3e21b-1460-4da2-bfcc-258303d2719e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.571659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd3e21b-1460-4da2-bfcc-258303d2719e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.571659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd3e21b-1460-4da2-bfcc-258303d2719e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.571659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd3e21b-1460-4da2-bfcc-258303d2719e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.571659] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd3e21b-1460-4da2-bfcc-258303d2719e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.845569] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.845726] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.845791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.846051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.847030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.847030] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be updated. [ 829.874024] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.874024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.874024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.874501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.874709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.882680] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 830.066746] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.067113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.074314] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.075647] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddd3e21b-1460-4da2-bfcc-258303d2719e with status ACTIVE [ 830.082150] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.082150] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.082150] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.082150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.082150] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddd3e21b-1460-4da2-bfcc-258303d2719e is going to be updated. [ 830.103433] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.103966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.104152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.104430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.104671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.106087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd3e21b-1460-4da2-bfcc-258303d2719e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.283860] env[62620]: INFO networking_nsxv3.common.synchronization [req-25726b59-90a5-4950-a311-d646bc9578fd req-866ee9e3-72a2-42a0-9368-542aa60d33ed tempest-ServerRescueNegativeTestJSON-1339547319 tempest-ServerRescueNegativeTestJSON-1339547319-project-member] Enqueued Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 830.284671] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 830.288433] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.288624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.460518] env[62620]: INFO networking_nsxv3.common.synchronization [req-283edade-b2c2-46cb-aeec-7eeafacf7be6 req-7a6503d5-d981-4868-8f25-5d25ca27dccf tempest-ListServersNegativeTestJSON-1492694773 tempest-ListServersNegativeTestJSON-1492694773-project-member] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 830.461066] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGHEST for action security_group_members [ 830.463397] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.463397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.544124] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: SUCCESS [ 830.544274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.585569] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.876389] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.876595] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.876724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.877008] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.877285] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.877534] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.877612] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.877803] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.877984] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.880676] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.880827] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.881128] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.881128] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.881244] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.881345] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.881851] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.899703] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.899909] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 830.900038] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.900235] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.900634] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-4eb9bc28-5e4b-4b2e-859d-31b930210e13 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.900844] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-4eb9bc28-5e4b-4b2e-859d-31b930210e13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.900977] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-4eb9bc28-5e4b-4b2e-859d-31b930210e13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.901325] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-4eb9bc28-5e4b-4b2e-859d-31b930210e13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.901491] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb9bc28-5e4b-4b2e-859d-31b930210e13',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.090289] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.090513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.090624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.090938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.091076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.091202] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 is going to be created. [ 831.114372] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.114592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.114722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.114985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.115198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.125010] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: UNINITIALIZED for 2s [ 831.404979] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.405236] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.405379] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.405697] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.405856] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.406057] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 4eb9bc28-5e4b-4b2e-859d-31b930210e13 not found, creating... [ 831.406346] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.406513] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.406637] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.406870] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.407032] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.407327] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.407486] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.407607] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.407853] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.408050] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.408225] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 4eb9bc28-5e4b-4b2e-859d-31b930210e13 is going to be created. [ 831.440163] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.440390] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.440462] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.440754] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.440991] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.441234] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-4eb9bc28-5e4b-4b2e-859d-31b930210e13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.774795] env[62620]: INFO networking_nsxv3.common.synchronization [req-d2df91bd-7efc-46d9-9c39-f6d0d85eee8d req-60d62e60-d92b-4f52-8db4-33ef84101458 tempest-AttachInterfacesV270Test-1651543906 tempest-AttachInterfacesV270Test-1651543906-project-member] Enqueued Resource ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd with Priority: HIGHEST for action security_group_members [ 831.775414] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd with Priority: HIGHEST for action security_group_members [ 831.776625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.776830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.776946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.777235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.777474] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.777474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.777649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.777910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.777910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.777910] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2bbf04f-3b75-4f98-a58c-b7dfe66747dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.893079] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 831.894047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.894047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.894047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.894237] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.894237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.894321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.894864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.894864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.894864] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.281195] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.281364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.281438] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.281673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.281773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.281972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.282088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.282154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.282317] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.282398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.282487] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd is going to be updated. [ 832.309155] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.309314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.309420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.309591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.309754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.317532] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd in Status: IN_PROGRESS for 2s [ 832.361153] env[62620]: INFO networking_nsxv3.common.synchronization [req-25726b59-90a5-4950-a311-d646bc9578fd req-4e0b0f30-75ea-4335-9dbf-6cb0608c81ee service nova] Enqueued Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_rules [ 832.362287] env[62620]: INFO networking_nsxv3.common.synchronization [req-25726b59-90a5-4950-a311-d646bc9578fd req-4e0b0f30-75ea-4335-9dbf-6cb0608c81ee service nova] Enqueued Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 832.362287] env[62620]: INFO networking_nsxv3.common.synchronization [req-25726b59-90a5-4950-a311-d646bc9578fd req-4e0b0f30-75ea-4335-9dbf-6cb0608c81ee service nova] Enqueued Resource ID: 4eb9bc28-5e4b-4b2e-859d-31b930210e13 with Priority: HIGHEST for action port [ 832.362287] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_rules [ 832.362287] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 832.362287] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb9bc28-5e4b-4b2e-859d-31b930210e13 with Priority: HIGHEST for action port [ 832.362763] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.362905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.363787] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.363931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.364185] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb9bc28-5e4b-4b2e-859d-31b930210e13 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.364327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb9bc28-5e4b-4b2e-859d-31b930210e13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.364420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb9bc28-5e4b-4b2e-859d-31b930210e13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.364671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb9bc28-5e4b-4b2e-859d-31b930210e13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.364794] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb9bc28-5e4b-4b2e-859d-31b930210e13',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.400019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.400019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.400019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.400019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.436944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.437553] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.437553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.437689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.437788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.437877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.437971] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be updated. [ 832.472453] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.472536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.472602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.472882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.473076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.482658] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: IN_PROGRESS for 2s [ 832.868913] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4eb9bc28-5e4b-4b2e-859d-31b930210e13 with status ACTIVE [ 832.868913] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.870671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.870671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.870671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.870671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.870671] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.870671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.870671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.871397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.871397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.871397] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.871655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.871710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.871938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.872070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.872202] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4eb9bc28-5e4b-4b2e-859d-31b930210e13 is going to be updated. [ 832.892323] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.892677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.892677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.893858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.893858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.893858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb9bc28-5e4b-4b2e-859d-31b930210e13" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.094159] env[62620]: INFO networking_nsxv3.common.synchronization [req-1426df85-0b55-489d-b7c7-7339f4925e9c req-35f991c0-0985-4e9e-8207-3aeda28a9540 tempest-ListImageFiltersTestJSON-306267884 tempest-ListImageFiltersTestJSON-306267884-project-member] Enqueued Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 833.094740] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 833.095057] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.095200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.095256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.095489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.095677] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.095745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.095798] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.095950] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.096071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.096167] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.136342] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: UNINITIALIZED for 4s [ 833.598754] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.598923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.599132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.599262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.599360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.599567] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.599675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.599737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.599897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.599967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.600060] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c72dcb51-694a-46ed-b921-12a44f522163 already deleted. [ 833.600140] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.919562] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.919562] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.919562] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.921846] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.922453] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.923030] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.924247] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.924247] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.924247] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.924247] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.925379] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.925615] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.925954] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.927036] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.927036] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.927036] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.947409] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.948043] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 833.948043] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.948043] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.948970] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.948970] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.948970] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.948970] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.949183] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd8176d-4f10-4dcc-9b49-f53a48ec4cc4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.329893] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd in Status: SUCCESS [ 834.329893] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2bbf04f-3b75-4f98-a58c-b7dfe66747dd deletion is rescheduled due to dependency. [ 834.329893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2bbf04f-3b75-4f98-a58c-b7dfe66747dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.456531] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.456531] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.456647] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.456885] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.457044] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.457201] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port abd8176d-4f10-4dcc-9b49-f53a48ec4cc4 not found, creating... [ 834.457463] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.457619] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.457734] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.458309] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.458309] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.458436] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.458605] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.458784] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.459119] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.459275] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.460031] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: abd8176d-4f10-4dcc-9b49-f53a48ec4cc4 is going to be created. [ 834.478775] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.478775] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.478775] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.478945] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.479292] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.479570] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.492152] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff in Status: SUCCESS [ 834.492338] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff deletion is rescheduled due to dependency. [ 834.492454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.145698] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: SUCCESS [ 835.145966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.146701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.146701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.146701] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.150277] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.150277] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.150277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.150277] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.389023] env[62620]: INFO networking_nsxv3.common.synchronization [req-1426df85-0b55-489d-b7c7-7339f4925e9c req-1ea5dd34-7129-499c-a183-9c274412ba07 service nova] Enqueued Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_rules [ 835.389237] env[62620]: INFO networking_nsxv3.common.synchronization [req-1426df85-0b55-489d-b7c7-7339f4925e9c req-1ea5dd34-7129-499c-a183-9c274412ba07 service nova] Enqueued Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 835.389406] env[62620]: INFO networking_nsxv3.common.synchronization [req-1426df85-0b55-489d-b7c7-7339f4925e9c req-1ea5dd34-7129-499c-a183-9c274412ba07 service nova] Enqueued Resource ID: abd8176d-4f10-4dcc-9b49-f53a48ec4cc4 with Priority: HIGHEST for action port [ 835.389644] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_rules [ 835.389794] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 835.389903] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd8176d-4f10-4dcc-9b49-f53a48ec4cc4 with Priority: HIGHEST for action port [ 835.390498] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.390632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.390845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.390976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.395345] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.396238] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.396379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.396449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.396696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.396818] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.396910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.397080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.397148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.397241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.397343] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.398204] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.398311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.398677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.398677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.398677] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd8176d-4f10-4dcc-9b49-f53a48ec4cc4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.652301] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.652453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.652642] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.710101] env[62620]: INFO networking_nsxv3.common.synchronization [req-d5474d12-367e-4429-9f89-592f2e3a2db8 req-9871924f-5023-4ef5-98c5-ac613ae4d9ba tempest-DeleteServersAdminTestJSON-1615940801 tempest-DeleteServersAdminTestJSON-1615940801-project-member] Enqueued Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 835.710834] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGHEST for action security_group_members [ 835.712950] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.714328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.714328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.714328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.714328] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.714328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.714328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.714328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.714328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.714328] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.900465] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.900841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.900841] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.904640] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abd8176d-4f10-4dcc-9b49-f53a48ec4cc4 with status ACTIVE [ 835.904640] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.904640] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.904640] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.904640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.904640] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abd8176d-4f10-4dcc-9b49-f53a48ec4cc4 is going to be updated. [ 835.924083] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.924430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.924430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.924592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.924700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.924817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abd8176d-4f10-4dcc-9b49-f53a48ec4cc4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.156701] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.217738] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.217738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.217738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.217738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.217738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.218038] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.218038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.218038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.218217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.218257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.218345] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 is going to be updated. [ 836.247508] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.247508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.247508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.247508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.247508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.255368] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: IN_PROGRESS for 2s [ 836.403198] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.658919] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.658919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.658919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.659127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.659187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.659286] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 is going to be updated. [ 836.686282] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.687019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.687019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.687210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.687360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.695475] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: IN_PROGRESS for 2s [ 836.907526] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.907729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.907805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.908052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.908147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.908272] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c72dcb51-694a-46ed-b921-12a44f522163 is going to be created. [ 836.933710] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.933710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.933710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.933710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.933710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.943016] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: UNINITIALIZED for 2s [ 837.108248] env[62620]: INFO networking_nsxv3.common.synchronization [req-5ee060a4-18b1-430b-b006-fc65598f3752 req-a6f635eb-b30e-447b-8ad1-014655685bdf tempest-ListImageFiltersTestJSON-306267884 tempest-ListImageFiltersTestJSON-306267884-project-member] Enqueued Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 837.108780] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 837.109188] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.109312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.603896] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.604218] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.604701] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.604778] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.605072] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.605329] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.605769] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.606056] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.606192] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.606445] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.606580] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.606699] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.606826] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.606945] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.607066] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.607210] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.624299] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.624459] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.624606] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.624824] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.625271] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-7b046d10-1606-48ca-9f84-f34e991b5dd5 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.625386] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-7b046d10-1606-48ca-9f84-f34e991b5dd5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.625509] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-7b046d10-1606-48ca-9f84-f34e991b5dd5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.625832] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-7b046d10-1606-48ca-9f84-f34e991b5dd5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.626081] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b046d10-1606-48ca-9f84-f34e991b5dd5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.129181] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.129418] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.129578] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.129850] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.130068] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.130239] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 7b046d10-1606-48ca-9f84-f34e991b5dd5 not found, creating... [ 838.130507] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.130668] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.130788] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.131024] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.131250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.131477] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.131609] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.131721] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.131930] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.132083] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.132228] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 7b046d10-1606-48ca-9f84-f34e991b5dd5 is going to be created. [ 838.150632] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.150886] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.151083] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.151558] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.151639] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.151920] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-7b046d10-1606-48ca-9f84-f34e991b5dd5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.265653] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 in Status: SUCCESS [ 838.265845] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 deletion is rescheduled due to dependency. [ 838.265964] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.704997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: SUCCESS [ 838.705325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.705394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.706031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.706031] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.706031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.706031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.706242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.706242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.706295] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.905681] env[62620]: INFO networking_nsxv3.common.synchronization [req-5ee060a4-18b1-430b-b006-fc65598f3752 req-585f77c1-f086-42b0-b3dc-75780ca7eb6f service nova] Enqueued Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_rules [ 838.905868] env[62620]: INFO networking_nsxv3.common.synchronization [req-5ee060a4-18b1-430b-b006-fc65598f3752 req-585f77c1-f086-42b0-b3dc-75780ca7eb6f service nova] Enqueued Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 838.906111] env[62620]: INFO networking_nsxv3.common.synchronization [req-5ee060a4-18b1-430b-b006-fc65598f3752 req-585f77c1-f086-42b0-b3dc-75780ca7eb6f service nova] Enqueued Resource ID: 7b046d10-1606-48ca-9f84-f34e991b5dd5 with Priority: HIGHEST for action port [ 838.906423] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_rules [ 838.906568] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 838.906671] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b046d10-1606-48ca-9f84-f34e991b5dd5 with Priority: HIGHEST for action port [ 838.907518] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.907615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.907899] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.908019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.908262] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b046d10-1606-48ca-9f84-f34e991b5dd5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.908397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b046d10-1606-48ca-9f84-f34e991b5dd5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.908502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b046d10-1606-48ca-9f84-f34e991b5dd5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.908748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b046d10-1606-48ca-9f84-f34e991b5dd5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.908945] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b046d10-1606-48ca-9f84-f34e991b5dd5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.951820] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: SUCCESS [ 838.952057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.952227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.952448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.952652] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.952793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.952861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.953037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.953116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.953201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.953306] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.957015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.957015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.957015] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.957015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.957015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.957015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.957015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.957015] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.207990] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.410915] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b046d10-1606-48ca-9f84-f34e991b5dd5 with status ACTIVE [ 839.411914] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.411914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.411914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.411914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.411914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.411914] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.412149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.412149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.412202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.412326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.412420] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.412510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.412573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.412702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.412771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.412852] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b046d10-1606-48ca-9f84-f34e991b5dd5 is going to be updated. [ 839.437181] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.437322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.437390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.437600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.437729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.437879] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b046d10-1606-48ca-9f84-f34e991b5dd5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.457452] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.457574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.461854] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.711042] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.965099] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.214944] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.214944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.214944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.214944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.214944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.214944] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 is going to be updated. [ 840.246117] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.246397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.246603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.246771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.246927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.256380] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: IN_PROGRESS for 2s [ 840.468310] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.468531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.468531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.468759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.468855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.468955] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c72dcb51-694a-46ed-b921-12a44f522163 is going to be updated. [ 840.495736] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.495899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.495948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.496162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.496311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.504194] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: IN_PROGRESS for 2s [ 842.265907] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: SUCCESS [ 842.266173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.266324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.266540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.266734] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.266849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.266972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.267077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.267161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.267248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.267404] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.267514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.267583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.267754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.270018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.270018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.270018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.270018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.270018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.270018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.270018] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.277043] env[62620]: INFO networking_nsxv3.common.synchronization [req-a2b9dec8-2925-4028-8cda-86c25f2035c6 req-bfa230aa-cc48-484d-a60a-bf125c86a3d8 tempest-FloatingIPsAssociationTestJSON-1435038635 tempest-FloatingIPsAssociationTestJSON-1435038635-project-member] Enqueued Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 842.277302] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGHEST for action security_group_members [ 842.280186] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.280321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.280391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.280583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.280744] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.280846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.280909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.281198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.281303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.284432] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.513676] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: SUCCESS [ 842.513984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.514172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.514389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.514572] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.514778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.514778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.514891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.514976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.515084] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.771313] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8ef3419-3f65-45f7-8a65-b4c2453d9fb8: rpc.has_security_group_logging(os_id): False [ 842.787121] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.787121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.787121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.787351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.797711] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.797711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.820163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.820163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.820163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.820163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.820163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.820163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.820163] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 is going to be updated. [ 842.821531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.821746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.821850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.822100] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.822229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.822292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.822449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.822552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.822726] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.822836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.822900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.823073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.823244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.823451] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.823545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.823968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.823968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.823968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.823968] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 is going to be created. [ 842.860027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.860027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.860221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.860528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.860528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.867601] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: IN_PROGRESS for 2s [ 842.886171] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.886363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.886404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.886622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.886805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.899518] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: IN_PROGRESS for 2s [ 843.017317] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.520457] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.023871] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.024079] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.024143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.024367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.024461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.024564] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c72dcb51-694a-46ed-b921-12a44f522163 is going to be updated. [ 844.052855] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.053086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.053162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.053375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.053519] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.064121] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: IN_PROGRESS for 2s [ 844.209439] env[62620]: INFO networking_nsxv3.common.synchronization [req-24933a10-6d62-45c8-a305-97ad42ef4e4b req-22bd3572-3f27-4ba0-9ecf-2f90fd293c6a tempest-ServerAddressesTestJSON-425948700 tempest-ServerAddressesTestJSON-425948700-project-member] Enqueued Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGHEST for action security_group_members [ 844.210344] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGHEST for action security_group_members [ 844.210666] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0ace76-b963-4700-a56b-d0352431deaf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.210785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.210850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.211129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.211254] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.211351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.211412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.211558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.211639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.211740] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec0ace76-b963-4700-a56b-d0352431deaf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.547711] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.547711] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-418" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.547711] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-418" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.548160] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-418" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.548662] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.548662] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.548662] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.548847] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.548923] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.549160] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.549926] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.549926] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.549926] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.549926] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.549926] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.549926] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.570865] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.570865] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.570865] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.570865] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-418" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.570865] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-499d7862-fc13-4d2b-8c15-6eab541a13f1 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.570865] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-499d7862-fc13-4d2b-8c15-6eab541a13f1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.570865] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-499d7862-fc13-4d2b-8c15-6eab541a13f1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.570865] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-499d7862-fc13-4d2b-8c15-6eab541a13f1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.570865] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('499d7862-fc13-4d2b-8c15-6eab541a13f1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.713666] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.713881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.713957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.714199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.714295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.714504] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.714662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.714662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.714829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.714909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.714994] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec0ace76-b963-4700-a56b-d0352431deaf already deleted. [ 844.715086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.878486] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 in Status: SUCCESS [ 844.878797] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 deletion is rescheduled due to dependency. [ 844.878797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.911107] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: SUCCESS [ 844.911107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.911107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.911301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.911301] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.074183] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.074493] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.074670] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.075666] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.075666] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.075666] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 499d7862-fc13-4d2b-8c15-6eab541a13f1 not found, creating... [ 845.075909] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.075967] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.076158] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.076446] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.077200] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.077200] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.077435] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.078349] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.078349] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.078349] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.078349] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 499d7862-fc13-4d2b-8c15-6eab541a13f1 is going to be created. [ 845.099133] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.099133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.099133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.099500] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.099716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.099993] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-499d7862-fc13-4d2b-8c15-6eab541a13f1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.414143] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.414289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.414363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.414589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.414763] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.414903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.414981] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.415140] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.415229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.415316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.415407] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.880221] env[62620]: INFO networking_nsxv3.common.synchronization [req-24933a10-6d62-45c8-a305-97ad42ef4e4b req-eff96702-6128-4e0f-a7ee-a18508f8262a service nova] Enqueued Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGHEST for action security_group_rules [ 845.880460] env[62620]: INFO networking_nsxv3.common.synchronization [req-24933a10-6d62-45c8-a305-97ad42ef4e4b req-eff96702-6128-4e0f-a7ee-a18508f8262a service nova] Enqueued Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGHEST for action security_group_members [ 845.880587] env[62620]: INFO networking_nsxv3.common.synchronization [req-24933a10-6d62-45c8-a305-97ad42ef4e4b req-eff96702-6128-4e0f-a7ee-a18508f8262a service nova] Enqueued Resource ID: 499d7862-fc13-4d2b-8c15-6eab541a13f1 with Priority: HIGHEST for action port [ 845.880839] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGHEST for action security_group_rules [ 845.880995] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGHEST for action security_group_members [ 845.881128] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 499d7862-fc13-4d2b-8c15-6eab541a13f1 with Priority: HIGHEST for action port [ 845.881751] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec0ace76-b963-4700-a56b-d0352431deaf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.881977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.881977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.883285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.883381] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec0ace76-b963-4700-a56b-d0352431deaf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.884279] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0ace76-b963-4700-a56b-d0352431deaf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.884396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.884465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.884648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.884805] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.884913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.884978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.885135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.885221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.885312] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec0ace76-b963-4700-a56b-d0352431deaf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.886095] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-499d7862-fc13-4d2b-8c15-6eab541a13f1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.886203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-499d7862-fc13-4d2b-8c15-6eab541a13f1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.886372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-499d7862-fc13-4d2b-8c15-6eab541a13f1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.886445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-499d7862-fc13-4d2b-8c15-6eab541a13f1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.886481] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('499d7862-fc13-4d2b-8c15-6eab541a13f1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.917685] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.920577] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.920577] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.920577] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.920577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.921135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.921135] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.073107] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: SUCCESS [ 846.073348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.073511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.073727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.073954] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.074087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.074155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.074316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.074401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.074489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.074643] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.074743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.074956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.075031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.075185] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.075281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.075337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.075478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.075554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.075634] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.075723] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.388992] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0ace76-b963-4700-a56b-d0352431deaf taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.389192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.389857] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec0ace76-b963-4700-a56b-d0352431deaf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.391340] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 499d7862-fc13-4d2b-8c15-6eab541a13f1 with status ACTIVE [ 846.391455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.391541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.391618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.391943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.392053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.392297] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.392412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.392412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.392539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.392612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.392821] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.392914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.393029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.393113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.393175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.393251] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 499d7862-fc13-4d2b-8c15-6eab541a13f1 is going to be updated. [ 846.422747] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8ef3419-3f65-45f7-8a65-b4c2453d9fb8: rpc.has_security_group_logging(os_id): False [ 846.425671] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.425904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.425904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.426099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.426231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.426381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-499d7862-fc13-4d2b-8c15-6eab541a13f1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.442472] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.442472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.442472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.442472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.442472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.442472] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.442472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.442472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.442791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.442791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.442865] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.442922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.442991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.443452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.443452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.443452] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.443452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.443598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.443626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.443786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.443846] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 is going to be updated. [ 846.524507] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.525424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.525424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.525424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.525424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.540777] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: IN_PROGRESS for 2s [ 846.579331] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c72dcb51-694a-46ed-b921-12a44f522163: rpc.has_security_group_logging(os_id): False [ 846.604167] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.604301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.604537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.604537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.604627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.604831] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.604928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.604996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.606214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.606310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.606527] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.606636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.606697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.606846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.606927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.607131] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.607228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.607294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.607436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.607513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.607598] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c72dcb51-694a-46ed-b921-12a44f522163 is going to be created. [ 846.694484] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.695017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.695017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.695139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.695255] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.708101] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: IN_PROGRESS for 2s [ 846.892216] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec0ace76-b963-4700-a56b-d0352431deaf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.395198] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.395349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.395416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.395641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.395735] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.395839] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec0ace76-b963-4700-a56b-d0352431deaf is going to be created. [ 847.424842] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.425449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.425449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.425449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.425712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.439972] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec0ace76-b963-4700-a56b-d0352431deaf in Status: UNINITIALIZED for 2s [ 848.557327] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: SUCCESS [ 848.557327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.721307] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: SUCCESS [ 848.721307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.721307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.721307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.721307] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.965723] env[62620]: INFO networking_nsxv3.common.synchronization [req-f74ab9a9-2e7b-4cbe-9e9f-bdbc2edd0063 req-a5214fc9-ce74-4eeb-ad0c-c315381d34ca tempest-ServersTestBootFromVolume-172209119 tempest-ServersTestBootFromVolume-172209119-project-member] Enqueued Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_members [ 848.966499] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGHEST for action security_group_members [ 848.966673] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa37dde5-b59c-4c95-8712-27727dd6ae4e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.966745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.966887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.967027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.970388] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.970388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.970388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.970388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.970388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.970388] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.223606] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.223857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.223944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.224163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.224336] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.224442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.224499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.224646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.224734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.224841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.224924] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.450519] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec0ace76-b963-4700-a56b-d0352431deaf in Status: SUCCESS [ 849.450651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.450858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.451085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.451361] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.451525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.451596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.451783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.451873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.452075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.452075] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec0ace76-b963-4700-a56b-d0352431deaf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.472435] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.472595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.472672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.473053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.491680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.492055] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.492223] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.492302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.492562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.492684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.492684] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e is going to be updated. [ 849.519223] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.519355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.519427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.519631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.519764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.528325] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e in Status: IN_PROGRESS for 2s [ 849.732029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.732029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.732029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.732029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.732029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.732965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.732965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.732965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.732965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.732965] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.954896] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0ace76-b963-4700-a56b-d0352431deaf taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.955130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.955238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.955482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.955692] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.955802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.955872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.956077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.956192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.956287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.956438] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0ace76-b963-4700-a56b-d0352431deaf taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.956545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.956668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.956754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.957018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.957018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.957153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.957233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.957329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.957496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.957540] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec0ace76-b963-4700-a56b-d0352431deaf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.235542] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c72dcb51-694a-46ed-b921-12a44f522163: rpc.has_security_group_logging(os_id): False [ 850.255476] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.255681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.255723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.255936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.256050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.256285] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.256407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.256467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.256603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.256680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.256875] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.256971] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.257047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.257198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.257274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.257465] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.257560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.257622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.257763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.257840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.257929] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c72dcb51-694a-46ed-b921-12a44f522163 is going to be updated. [ 850.325039] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.325039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.325039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.325039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.325039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.339446] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: IN_PROGRESS for 2s [ 850.460493] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec0ace76-b963-4700-a56b-d0352431deaf: rpc.has_security_group_logging(os_id): False [ 850.478568] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.478741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.480353] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.480353] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.480353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.480797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.480797] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.480797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.480797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.480931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.481172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.481311] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec0ace76-b963-4700-a56b-d0352431deaf is going to be created. [ 850.545785] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.545999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.546073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.546360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.546587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.557141] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec0ace76-b963-4700-a56b-d0352431deaf in Status: IN_PROGRESS for 2s [ 851.538488] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e in Status: SUCCESS [ 851.538834] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e deletion is rescheduled due to dependency. [ 851.538977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.353625] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: SUCCESS [ 852.353625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.568567] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec0ace76-b963-4700-a56b-d0352431deaf in Status: SUCCESS [ 852.568968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 853.967640] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 853.967951] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 854.692571] env[62620]: INFO networking_nsxv3.common.synchronization [req-6ee298e0-8966-4275-82fa-797da2540e1c req-3c136e74-1c43-416c-bef4-bf3a4c8d0909 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 854.693167] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 854.695024] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.695176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.695238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.695503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.695685] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.695825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.695905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.696184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.696263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.696337] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.198867] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.349124] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.349334] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-988" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.349464] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-988" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.349769] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-988" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.350064] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.350281] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.350443] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.350695] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.350834] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.351057] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.351173] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.351277] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.351387] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.351923] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.351923] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.351923] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.370359] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.370536] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 855.370702] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.370896] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-988" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.371277] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-bf72690a-0358-469d-8d21-85ef459cbcb9 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.371937] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.371937] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.372077] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.372163] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf72690a-0358-469d-8d21-85ef459cbcb9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.701454] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.874888] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.875167] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.876082] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.876082] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.876082] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.876082] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port bf72690a-0358-469d-8d21-85ef459cbcb9 not found, creating... [ 855.876303] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.876477] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.876601] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.876892] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.877024] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.877480] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.877747] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.877902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.878152] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.878297] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.878491] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: bf72690a-0358-469d-8d21-85ef459cbcb9 is going to be created. [ 855.897672] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.897968] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.898151] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.898419] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.898649] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.898938] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.205393] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.205393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.205393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.205855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.205855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.205855] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 856.237383] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.237604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.237713] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.238021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.238247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.247349] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 856.792050] env[62620]: INFO networking_nsxv3.common.synchronization [req-9ee09dc4-abf3-444a-b97a-c68df2d6168f req-122a6001-9200-4c8a-8a39-da4dfceec6f8 tempest-ServerAddressesTestJSON-425948700 tempest-ServerAddressesTestJSON-425948700-project-member] Enqueued Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGHEST for action security_group_members [ 856.792050] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGHEST for action security_group_members [ 856.792050] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0ace76-b963-4700-a56b-d0352431deaf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.792050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.792050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.792050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.792374] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.792374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.792452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.792589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.792686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.792801] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec0ace76-b963-4700-a56b-d0352431deaf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.836166] env[62620]: INFO networking_nsxv3.common.synchronization [req-6ee298e0-8966-4275-82fa-797da2540e1c req-d95c0270-84cd-4371-8e73-903925550aae service nova] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 856.836166] env[62620]: INFO networking_nsxv3.common.synchronization [req-6ee298e0-8966-4275-82fa-797da2540e1c req-d95c0270-84cd-4371-8e73-903925550aae service nova] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 856.836315] env[62620]: INFO networking_nsxv3.common.synchronization [req-6ee298e0-8966-4275-82fa-797da2540e1c req-d95c0270-84cd-4371-8e73-903925550aae service nova] Enqueued Resource ID: bf72690a-0358-469d-8d21-85ef459cbcb9 with Priority: HIGHEST for action port [ 856.836824] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 856.837046] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 856.837092] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf72690a-0358-469d-8d21-85ef459cbcb9 with Priority: HIGHEST for action port [ 856.837722] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.837889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.837960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.841157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.841157] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.841157] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.841157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.841527] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf72690a-0358-469d-8d21-85ef459cbcb9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.841527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.841527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.841662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.841848] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf72690a-0358-469d-8d21-85ef459cbcb9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.300039] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.300039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.300039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.300039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.300039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.300039] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.300039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.300039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.300039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.300039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.300039] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec0ace76-b963-4700-a56b-d0352431deaf is going to be updated. [ 857.341899] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.342122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.348738] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf72690a-0358-469d-8d21-85ef459cbcb9 with status ACTIVE [ 857.348858] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.349313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.349313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.349462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.349542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.349775] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.349856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.349912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.350168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.350226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.350410] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.350552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.350594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.350717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.350810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.350900] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf72690a-0358-469d-8d21-85ef459cbcb9 is going to be updated. [ 857.377023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.377023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.377023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.377023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.377023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.386999] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec0ace76-b963-4700-a56b-d0352431deaf in Status: IN_PROGRESS for 2s [ 857.394942] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.394942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.394942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.394942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.394942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.394942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.451113] env[62620]: INFO networking_nsxv3.common.synchronization [req-855f1cb1-2e3c-47b0-a24a-22ec236e0b4f req-ee6aa33b-5d56-499f-9aa1-e3992a4044b3 tempest-ServerExternalEventsTest-1806940606 tempest-ServerExternalEventsTest-1806940606-project-member] Enqueued Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGHEST for action security_group_members [ 857.451113] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGHEST for action security_group_members [ 857.451113] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5648415-b62c-4796-a92a-229b5e585bfa taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.451649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.451649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.451649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.451828] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.451828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.451828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.452015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.452236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.452354] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5648415-b62c-4796-a92a-229b5e585bfa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.955139] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.955323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.955391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.955603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.955729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.955908] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.959020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.959020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.959020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.959020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.959020] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5648415-b62c-4796-a92a-229b5e585bfa already deleted. [ 857.959020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.016993] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.018018] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.018018] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.018770] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.019085] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.021351] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.021351] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.021351] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.021351] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.021351] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.021351] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.021351] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.021351] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.021351] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.021351] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.022042] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.041477] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.041477] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 858.041477] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.041477] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.041477] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.041477] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.041477] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.042740] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.043157] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.257551] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 858.261022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.261022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.261022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.261022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.261022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.261022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.261022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.261022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.261022] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.546073] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.546466] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.546466] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.546804] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.547019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.547232] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f not found, creating... [ 858.547552] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.547772] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.547980] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.548254] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.548451] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.548803] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.548976] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.549114] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.549361] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.549659] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.549659] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f is going to be created. [ 858.568456] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.568672] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.568802] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.569098] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.569668] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.569668] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.763811] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.265861] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.317517] env[62620]: INFO networking_nsxv3.common.synchronization [req-855f1cb1-2e3c-47b0-a24a-22ec236e0b4f req-b0d10fbf-e8cd-4fc1-8fa5-05ceeed6a777 service nova] Enqueued Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGHEST for action security_group_rules [ 859.317687] env[62620]: INFO networking_nsxv3.common.synchronization [req-855f1cb1-2e3c-47b0-a24a-22ec236e0b4f req-b0d10fbf-e8cd-4fc1-8fa5-05ceeed6a777 service nova] Enqueued Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGHEST for action security_group_members [ 859.317824] env[62620]: INFO networking_nsxv3.common.synchronization [req-855f1cb1-2e3c-47b0-a24a-22ec236e0b4f req-b0d10fbf-e8cd-4fc1-8fa5-05ceeed6a777 service nova] Enqueued Resource ID: 2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f with Priority: HIGHEST for action port [ 859.319675] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGHEST for action security_group_rules [ 859.320811] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGHEST for action security_group_members [ 859.320811] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f with Priority: HIGHEST for action port [ 859.320811] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5648415-b62c-4796-a92a-229b5e585bfa taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.320811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.320811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.320811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.320811] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5648415-b62c-4796-a92a-229b5e585bfa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.321565] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5648415-b62c-4796-a92a-229b5e585bfa taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.321680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.321737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.321919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.322070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.322177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.322251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.322441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.322527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.322619] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5648415-b62c-4796-a92a-229b5e585bfa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.323837] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.323959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.324894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.324894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.324894] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.397643] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec0ace76-b963-4700-a56b-d0352431deaf in Status: SUCCESS [ 859.397828] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec0ace76-b963-4700-a56b-d0352431deaf deletion is rescheduled due to dependency. [ 859.397941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.771768] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.771768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.771768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.771768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.771768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.771768] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 859.797273] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.797443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.797562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.797797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.799278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.806348] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 859.826879] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5648415-b62c-4796-a92a-229b5e585bfa taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.827020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.827227] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5648415-b62c-4796-a92a-229b5e585bfa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.828326] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f with status ACTIVE [ 859.828326] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.828457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.828935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.828935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.828935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.829159] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.829159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.829159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.829389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.829579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.829817] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.829982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.829982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.830244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.830307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.830383] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f is going to be updated. [ 859.851205] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.851674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.851957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.852274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.852546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.852843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2807cd3b-e852-4c5c-bd4c-409c4d5c7e2f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.332949] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5648415-b62c-4796-a92a-229b5e585bfa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.407288] env[62620]: INFO networking_nsxv3.common.synchronization [req-eb3f36df-1ab0-46c3-8365-53414ad6f4eb req-e22ec667-96c3-4965-be62-77ad0ade2c1d tempest-ServerRescueTestJSON-1890721172 tempest-ServerRescueTestJSON-1890721172-project-member] Enqueued Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 860.407288] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 860.407288] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.407288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.407288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.407917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.408243] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.408828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.409032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.409399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.409576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.409751] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.841202] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.841670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.841670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.841670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.841952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.841952] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5648415-b62c-4796-a92a-229b5e585bfa is going to be created. [ 860.868065] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.868289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.868383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.868726] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.868845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.879141] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5648415-b62c-4796-a92a-229b5e585bfa in Status: UNINITIALIZED for 2s [ 860.912160] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.912397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.912459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.912702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.912801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.913111] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.913260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.913341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.914215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.914364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.914441] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 already deleted. [ 860.914552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.251209] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.251510] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-293" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.251919] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-293" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.252177] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-293" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.252598] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.252867] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.253106] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.253462] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.253718] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.254120] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.254326] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.254535] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.254773] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.254988] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.255119] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.255339] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.275428] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.275597] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.275683] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.275867] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-293" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.276254] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-f91eb28c-7881-4e2c-b51e-7c0f169652d1 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.276517] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-f91eb28c-7881-4e2c-b51e-7c0f169652d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.276663] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-f91eb28c-7881-4e2c-b51e-7c0f169652d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.277014] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-f91eb28c-7881-4e2c-b51e-7c0f169652d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.277199] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91eb28c-7881-4e2c-b51e-7c0f169652d1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.780080] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.780328] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.780440] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.780740] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.780962] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.781198] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port f91eb28c-7881-4e2c-b51e-7c0f169652d1 not found, creating... [ 861.781553] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.781784] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.781952] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.782257] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.782481] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.782800] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.783012] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.783142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.783419] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.783573] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.783743] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: f91eb28c-7881-4e2c-b51e-7c0f169652d1 is going to be created. [ 861.803054] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.803317] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.803466] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.803763] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.804082] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.804345] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-f91eb28c-7881-4e2c-b51e-7c0f169652d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.814332] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 861.814587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.814755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.814994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.815213] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.815359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.815427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.815599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.815679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.815765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.815874] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.318604] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.319063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.319063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.319392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.319674] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.319855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.319966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.320259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.320409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.320501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.320685] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.320795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.320855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.321056] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.321270] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.323165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.323273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.323501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.323596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.323705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.323808] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.682757] env[62620]: INFO networking_nsxv3.common.synchronization [req-14e13a18-54b9-4ee7-8a29-56a51d628a23 req-22141e3d-0d08-479b-ac4c-81aaf37df215 tempest-ImagesOneServerTestJSON-1340245844 tempest-ImagesOneServerTestJSON-1340245844-project-member] Enqueued Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGHEST for action security_group_members [ 862.683377] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGHEST for action security_group_members [ 862.686018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84776719-6313-41bf-88fe-129baf34c6ed taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.686018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.686018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.686018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.686018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.686018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.686018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.686018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.686018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.686018] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84776719-6313-41bf-88fe-129baf34c6ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.827952] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daf462fc-bab6-4357-af22-b6d35dd411dd: rpc.has_security_group_logging(os_id): False [ 862.845767] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.845908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.845976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.846567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.864427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.864713] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.864929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.864929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.865187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.865280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.865482] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.865584] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.865647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.865800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.865882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.866949] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.866949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.866949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.866949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.866949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.866949] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 862.887991] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5648415-b62c-4796-a92a-229b5e585bfa in Status: SUCCESS [ 862.887991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.887991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.887991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.887991] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.887991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.887991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.887991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.888354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.888354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.888354] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5648415-b62c-4796-a92a-229b5e585bfa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.924394] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.924394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.924394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.924394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.924394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.941043] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 863.188319] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.188636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.188636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.188710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.188763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.188945] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.189057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.189121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.189268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.189358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.189459] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84776719-6313-41bf-88fe-129baf34c6ed is going to be updated. [ 863.219876] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.220116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.220116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.220320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.220569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.229398] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84776719-6313-41bf-88fe-129baf34c6ed in Status: IN_PROGRESS for 2s [ 863.251828] env[62620]: INFO networking_nsxv3.common.synchronization [req-eb3f36df-1ab0-46c3-8365-53414ad6f4eb req-52c07abe-b470-49af-9f98-2fa6f3f80b33 service nova] Enqueued Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_rules [ 863.252053] env[62620]: INFO networking_nsxv3.common.synchronization [req-eb3f36df-1ab0-46c3-8365-53414ad6f4eb req-52c07abe-b470-49af-9f98-2fa6f3f80b33 service nova] Enqueued Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 863.252309] env[62620]: INFO networking_nsxv3.common.synchronization [req-eb3f36df-1ab0-46c3-8365-53414ad6f4eb req-52c07abe-b470-49af-9f98-2fa6f3f80b33 service nova] Enqueued Resource ID: f91eb28c-7881-4e2c-b51e-7c0f169652d1 with Priority: HIGHEST for action port [ 863.252826] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_rules [ 863.252960] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 863.253187] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f91eb28c-7881-4e2c-b51e-7c0f169652d1 with Priority: HIGHEST for action port [ 863.253512] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.253595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.253672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.253989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.254117] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.255058] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.255183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.255255] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.255442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.255593] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.255729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.255776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.255884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.255969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.256072] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.256945] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-f91eb28c-7881-4e2c-b51e-7c0f169652d1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.257183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f91eb28c-7881-4e2c-b51e-7c0f169652d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.257306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f91eb28c-7881-4e2c-b51e-7c0f169652d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.257545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f91eb28c-7881-4e2c-b51e-7c0f169652d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.257673] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91eb28c-7881-4e2c-b51e-7c0f169652d1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.392028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5648415-b62c-4796-a92a-229b5e585bfa taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.392028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.392028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.392028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.392028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.392028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.392587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.392587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.392587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.392587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.392691] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5648415-b62c-4796-a92a-229b5e585bfa taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.392731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.392832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.392928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.393078] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.393168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.393865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.393865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.393865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.393865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.393865] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5648415-b62c-4796-a92a-229b5e585bfa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.449134] env[62620]: INFO networking_nsxv3.common.synchronization [req-647f694d-9af8-4055-9905-bd3791563680 req-88c240ce-cbb6-4cde-8dea-376cf5e556fa tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 863.449662] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 863.450135] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.450286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.450358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.450636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.450798] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.450890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.451041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.451155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.451244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.451364] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.759844] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.760044] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.760379] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.763335] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f91eb28c-7881-4e2c-b51e-7c0f169652d1 with status ACTIVE [ 863.763335] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.763335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.763335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.763335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.763335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.763335] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.763335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.763335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.763335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.763335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.763335] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.763763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.763763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.763763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.763763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.763950] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f91eb28c-7881-4e2c-b51e-7c0f169652d1 is going to be updated. [ 863.785296] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.785504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.785559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.785741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.785881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.786074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f91eb28c-7881-4e2c-b51e-7c0f169652d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.846371] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.846616] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.846768] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.847088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.847397] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.847600] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.847758] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.848044] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.848233] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.848483] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.848610] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.848741] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.848859] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.848997] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.849148] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.849309] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.868093] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.868380] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 863.868425] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.868593] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.868966] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-202d765c-7217-40e5-9216-6ffe27003834 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.869093] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-202d765c-7217-40e5-9216-6ffe27003834" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.869219] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-202d765c-7217-40e5-9216-6ffe27003834" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.869574] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-202d765c-7217-40e5-9216-6ffe27003834" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.869727] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('202d765c-7217-40e5-9216-6ffe27003834',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.896792] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5648415-b62c-4796-a92a-229b5e585bfa: rpc.has_security_group_logging(os_id): False [ 863.924221] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.925105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.925105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.925105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.925105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.925105] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.925105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.925105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.925457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.925457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.925568] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.925646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.925922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.925922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.925922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.926143] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.926190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.926279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.926393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.926483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.926483] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5648415-b62c-4796-a92a-229b5e585bfa is going to be created. [ 863.958300] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.958459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.958540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.958799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.958923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.959196] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.959337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.959407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.959593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.959693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.959784] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 already deleted. [ 863.959868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.014609] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.014842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.014842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.015092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.015307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.027028] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5648415-b62c-4796-a92a-229b5e585bfa in Status: IN_PROGRESS for 2s [ 864.265822] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.372456] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.372718] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.372851] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.373195] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.373360] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.373522] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 202d765c-7217-40e5-9216-6ffe27003834 not found, creating... [ 864.374370] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.374370] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.374370] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.374578] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.374711] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.375019] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.375188] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.375308] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.375530] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.375666] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.375807] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 202d765c-7217-40e5-9216-6ffe27003834 is going to be created. [ 864.398942] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.398942] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.398942] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.398942] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.398942] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.398942] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-202d765c-7217-40e5-9216-6ffe27003834" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.768837] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.769025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.769167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.769528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.769908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.770089] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 is going to be created. [ 864.795173] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.795356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.795394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.795872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.796096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.805215] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: UNINITIALIZED for 2s [ 864.954574] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 864.955024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.246979] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84776719-6313-41bf-88fe-129baf34c6ed in Status: SUCCESS [ 865.247229] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84776719-6313-41bf-88fe-129baf34c6ed deletion is rescheduled due to dependency. [ 865.247353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.277527] env[62620]: INFO networking_nsxv3.common.synchronization [req-e07ad398-ec59-4e97-90ad-096feeaf607f req-12435214-26a0-4b41-b692-fae9953265fe tempest-ImagesOneServerNegativeTestJSON-1314187372 tempest-ImagesOneServerNegativeTestJSON-1314187372-project-member] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 865.278431] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 865.278861] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.281020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.281020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.281020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.281020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.281020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.281020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.281020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.281020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.281020] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.488429] env[62620]: INFO networking_nsxv3.common.synchronization [req-647f694d-9af8-4055-9905-bd3791563680 req-3f44277b-d231-483e-849f-f8e50c652ddf service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 865.488737] env[62620]: INFO networking_nsxv3.common.synchronization [req-647f694d-9af8-4055-9905-bd3791563680 req-3f44277b-d231-483e-849f-f8e50c652ddf service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 865.489928] env[62620]: INFO networking_nsxv3.common.synchronization [req-647f694d-9af8-4055-9905-bd3791563680 req-3f44277b-d231-483e-849f-f8e50c652ddf service nova] Enqueued Resource ID: 202d765c-7217-40e5-9216-6ffe27003834 with Priority: HIGHEST for action port [ 865.490236] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 865.490405] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 865.490534] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202d765c-7217-40e5-9216-6ffe27003834 with Priority: HIGHEST for action port [ 865.491494] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.491670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.491783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.492110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.492205] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.493123] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.493273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.493369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.493590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.493861] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.494126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.494235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.494450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.494659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.494659] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.495677] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-202d765c-7217-40e5-9216-6ffe27003834 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.495677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-202d765c-7217-40e5-9216-6ffe27003834" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.495786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-202d765c-7217-40e5-9216-6ffe27003834" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.495978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-202d765c-7217-40e5-9216-6ffe27003834" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.496095] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('202d765c-7217-40e5-9216-6ffe27003834',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.783220] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.783386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.783458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.783664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.783753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.784036] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.784186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.784257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.784416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.784497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.784585] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 already deleted. [ 865.784667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.833277] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.833509] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.833642] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.834137] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.834438] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.834612] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.834744] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.835195] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.835577] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.835760] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.835926] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.836091] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.836370] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.836370] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.836523] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.836714] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.854975] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.855197] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.855448] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.855836] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.856219] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-4eb23b03-8a91-47c9-8220-f878ec2488f3 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.857548] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-4eb23b03-8a91-47c9-8220-f878ec2488f3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.857548] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-4eb23b03-8a91-47c9-8220-f878ec2488f3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.857548] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-4eb23b03-8a91-47c9-8220-f878ec2488f3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.857548] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb23b03-8a91-47c9-8220-f878ec2488f3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.948238] env[62620]: INFO networking_nsxv3.common.synchronization [req-a8850c8e-2fce-441e-bc8c-d8aae1b92a55 req-68093eab-3944-4703-a3f7-241a276cf3e6 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 865.948402] env[62620]: INFO networking_nsxv3.common.synchronization [req-a8850c8e-2fce-441e-bc8c-d8aae1b92a55 req-68093eab-3944-4703-a3f7-241a276cf3e6 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 865.948883] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 865.949021] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 865.949297] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.949423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.949509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.949737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.949902] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.949998] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.950075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.950213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.950288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.950380] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.951211] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.953320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.953421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.953612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.953800] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.953923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.954043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.954247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.954364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.954467] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.001031] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.001031] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.001031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.001031] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 202d765c-7217-40e5-9216-6ffe27003834 with status ACTIVE [ 866.001031] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.001031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.001031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.001031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.001031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.001031] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.001031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.001031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.001646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.001646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.001884] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.002092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.002092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.002369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.002426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.002583] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 202d765c-7217-40e5-9216-6ffe27003834 is going to be updated. [ 866.008085] env[62620]: INFO networking_nsxv3.common.synchronization [req-a8850c8e-2fce-441e-bc8c-d8aae1b92a55 req-68093eab-3944-4703-a3f7-241a276cf3e6 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_rules [ 866.008284] env[62620]: INFO networking_nsxv3.common.synchronization [req-a8850c8e-2fce-441e-bc8c-d8aae1b92a55 req-68093eab-3944-4703-a3f7-241a276cf3e6 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 866.008443] env[62620]: INFO networking_nsxv3.common.synchronization [req-a8850c8e-2fce-441e-bc8c-d8aae1b92a55 req-68093eab-3944-4703-a3f7-241a276cf3e6 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 866.008575] env[62620]: INFO networking_nsxv3.common.synchronization [req-a8850c8e-2fce-441e-bc8c-d8aae1b92a55 req-68093eab-3944-4703-a3f7-241a276cf3e6 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 866.008702] env[62620]: INFO networking_nsxv3.common.synchronization [req-a8850c8e-2fce-441e-bc8c-d8aae1b92a55 req-68093eab-3944-4703-a3f7-241a276cf3e6 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: bf72690a-0358-469d-8d21-85ef459cbcb9 with Priority: HIGHEST for action port [ 866.010267] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_rules [ 866.010454] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 866.010666] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf72690a-0358-469d-8d21-85ef459cbcb9 with Priority: HIGHEST for action port [ 866.010799] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 866.010997] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 866.012238] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.012354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.012491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.012975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.013185] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.014148] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.014263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.014331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.014504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.014580] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.015757] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf72690a-0358-469d-8d21-85ef459cbcb9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.015944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.016086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.016630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.016630] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf72690a-0358-469d-8d21-85ef459cbcb9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.017859] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.018043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.018386] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.018541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.034675] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.034826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.034883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.035175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.035323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.035487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-202d765c-7217-40e5-9216-6ffe27003834" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.040422] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5648415-b62c-4796-a92a-229b5e585bfa in Status: SUCCESS [ 866.040568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.360674] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.360933] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.361092] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.361376] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.361537] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.361691] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 4eb23b03-8a91-47c9-8220-f878ec2488f3 not found, creating... [ 866.361989] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.362173] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.362297] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.362520] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.362663] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.362948] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.363122] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.363245] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.363459] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.363598] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.363740] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 4eb23b03-8a91-47c9-8220-f878ec2488f3 is going to be created. [ 866.388247] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.388453] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.388601] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.388945] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.389264] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.389549] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-4eb23b03-8a91-47c9-8220-f878ec2488f3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.456573] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.457604] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.507922] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.520186] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf72690a-0358-469d-8d21-85ef459cbcb9 with status ACTIVE [ 866.520186] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.520186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.520186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.520512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.520512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.520626] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.520800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.521865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.522062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.522161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.522370] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.522476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.522554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.522699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.522891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.523035] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf72690a-0358-469d-8d21-85ef459cbcb9 is going to be updated. [ 866.524389] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.524482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.524696] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.524778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.546389] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.546540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.546609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.546817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.546956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.547134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.815444] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: SUCCESS [ 866.815664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.815879] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.816149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.816362] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.816546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.816616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.816753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.816855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.816961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.817077] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.959481] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.960994] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.010523] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.010684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.010752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.011009] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.011126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.011225] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be created. [ 867.038361] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.038361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.038361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.038361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.038361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.048054] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: UNINITIALIZED for 2s [ 867.303304] env[62620]: INFO networking_nsxv3.common.synchronization [req-e07ad398-ec59-4e97-90ad-096feeaf607f req-ea348051-8b14-4efe-a9b6-a61fae20ebcd service nova] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_rules [ 867.303543] env[62620]: INFO networking_nsxv3.common.synchronization [req-e07ad398-ec59-4e97-90ad-096feeaf607f req-ea348051-8b14-4efe-a9b6-a61fae20ebcd service nova] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 867.303689] env[62620]: INFO networking_nsxv3.common.synchronization [req-e07ad398-ec59-4e97-90ad-096feeaf607f req-ea348051-8b14-4efe-a9b6-a61fae20ebcd service nova] Enqueued Resource ID: 4eb23b03-8a91-47c9-8220-f878ec2488f3 with Priority: HIGHEST for action port [ 867.304245] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_rules [ 867.304413] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 867.304518] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb23b03-8a91-47c9-8220-f878ec2488f3 with Priority: HIGHEST for action port [ 867.304794] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.304917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.305008] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.309446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.309663] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.311027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.311027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.311027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.311201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.311390] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.312192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.312192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.312192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.312192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.312192] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.313601] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb23b03-8a91-47c9-8220-f878ec2488f3 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.313800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb23b03-8a91-47c9-8220-f878ec2488f3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.313980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb23b03-8a91-47c9-8220-f878ec2488f3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.314266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb23b03-8a91-47c9-8220-f878ec2488f3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.314402] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb23b03-8a91-47c9-8220-f878ec2488f3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.319621] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.319621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.319621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.319774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.319934] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.319995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.320089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.320319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.320434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.320545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.320717] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.320807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.320900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.321090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.321261] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.321396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.321497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.321675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.321764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.321863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.321979] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.463877] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.463877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.463877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.463877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.463877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.464590] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623cf30-8f12-4744-a839-bb17de78b876 is going to be created. [ 867.465935] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.466075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.466148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.466347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.466441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.466537] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 867.488512] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.488715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.488839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.489109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.489315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.491413] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.491565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.491699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.491866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.492036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.499739] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 867.500436] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: UNINITIALIZED for 2s [ 867.816593] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.817741] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.817850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.818045] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4eb23b03-8a91-47c9-8220-f878ec2488f3 with status ACTIVE [ 867.818225] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.818339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.818405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.818610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.819139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.819139] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.819139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.819139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.819340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.819340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.819421] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.819688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.819688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.819688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.819793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.819836] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4eb23b03-8a91-47c9-8220-f878ec2488f3 is going to be updated. [ 867.823706] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b27f6472-ff8f-4e87-ba84-3f06d7d9c925: rpc.has_security_group_logging(os_id): False [ 867.839225] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.839388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.839431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.839608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.839697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.839905] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.840015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.840138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.840239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.840363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.840492] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.840585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.840693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.840783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.840857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.841043] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.841144] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.841197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.841341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.841428] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.841490] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 is going to be created. [ 867.843470] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.843631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.843688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.843800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.843927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.844142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb23b03-8a91-47c9-8220-f878ec2488f3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.902866] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.903111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.903157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.903366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.903570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.914829] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: IN_PROGRESS for 2s [ 868.321574] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.824679] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.825050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.825050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.825244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.825391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.825530] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be created. [ 868.851234] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.851472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.851472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.851694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.851881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.864930] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: UNINITIALIZED for 2s [ 869.057404] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 869.057511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.057637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.057850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.058057] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.058249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.058249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.058402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.058483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.058600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.058700] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.161108] env[62620]: INFO networking_nsxv3.common.synchronization [None req-94451597-18a9-4464-a644-4e16ebec3cce tempest-ServerRescueNegativeTestJSON-1339547319 tempest-ServerRescueNegativeTestJSON-1339547319-project-member] Enqueued Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_rules [ 869.161800] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_rules [ 869.162063] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.162405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.162405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.162674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.162780] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.237502] env[62620]: INFO networking_nsxv3.common.synchronization [None req-0a0b8688-8954-43f8-9650-122a07400048 tempest-ServerRescueNegativeTestJSON-1339547319 tempest-ServerRescueNegativeTestJSON-1339547319-project-member] Enqueued Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_rules [ 869.238487] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_rules [ 869.238487] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.238487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.510831] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 869.511083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.511818] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: SUCCESS [ 869.512074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.512241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.512462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.512646] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.512747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.512830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.512977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.513694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.513694] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.514728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.514979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.515272] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.515874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.516041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.516294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.516452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.516649] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.561290] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.563172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.563345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.563652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.565864] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.565864] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.565864] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.565864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.566435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.566900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.567122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.567271] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.686221] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.686425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.686680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.686928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.687062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.687181] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33d974dd-1e63-4b84-ae24-738b194f0483 already deleted. [ 869.687294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.687477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.687723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.687843] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.925822] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: SUCCESS [ 869.926198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.018857] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.020032] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.071036] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20f5a061-dbd0-44d6-953b-0f455ddef899: rpc.has_security_group_logging(os_id): False [ 870.088123] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.088278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.088351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.088931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.088931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.088931] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.088931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.089166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.089166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.089231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.089412] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.089506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.089568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.089708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.089782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.089966] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.090077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.090137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.090275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.090350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.090432] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be created. [ 870.142235] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.142430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.142430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.142616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.142806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.152216] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 870.209906] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.210123] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.210224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.210463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.211105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.211105] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33d974dd-1e63-4b84-ae24-738b194f0483 already deleted. [ 870.211105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.521797] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.525090] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.879143] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 870.879143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.879143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.879143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.879143] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.879143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.879143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.879143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.879143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.879143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.879143] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.025785] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.026132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.026132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.026346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.026509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.026656] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 871.028354] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.028473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.028545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.028732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.028816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.028910] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623cf30-8f12-4744-a839-bb17de78b876 is going to be updated. [ 871.064856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.067451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.067451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.067451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.067451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.067989] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.068172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.068213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.069026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.069026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.077755] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 871.078464] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: IN_PROGRESS for 2s [ 871.381600] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.381765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.381861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.382218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.382410] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.382524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.382590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.382753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.382843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.382931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.383138] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.383301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.383301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.383441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.383579] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.383727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.383727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.383888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.383940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.384040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.384117] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.889284] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95e0473d-1c6d-4b24-a6d9-f419a29f67f5: rpc.has_security_group_logging(os_id): False [ 871.907544] env[62620]: INFO networking_nsxv3.common.synchronization [req-4df07c0a-12f0-413c-90d3-aaa61c1e559a req-727720e7-d0ff-41c0-af1e-806d47991f5b tempest-VolumesAssistedSnapshotsTest-1178161758 tempest-VolumesAssistedSnapshotsTest-1178161758-project-member] Enqueued Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_members [ 871.910628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.910628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.910628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.910628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.910628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.910628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.910628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.910628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.910628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.910628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.910628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.911332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.911332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.911332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.911332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.912733] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.912733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.912733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.912733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.913068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.913199] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be created. [ 871.915063] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGHEST for action security_group_members [ 871.915253] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a6af52c-b1fd-4489-b26c-557260173089 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.915454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.915520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.915697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.915968] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.916218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.916281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.916454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.916536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.916634] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.968993] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.969188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.969275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.969516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.969787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.980673] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: IN_PROGRESS for 2s [ 872.165933] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 872.165933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.420700] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.420893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.420993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.422396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.445142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.445472] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.445727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.445727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.445875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.446043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.446223] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a6af52c-b1fd-4489-b26c-557260173089 is going to be updated. [ 872.479567] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.479781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.479873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.480600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.480600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.495242] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a6af52c-b1fd-4489-b26c-557260173089 in Status: IN_PROGRESS for 2s [ 873.094071] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 873.094071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.094071] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: SUCCESS [ 873.094071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.094071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.094071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.094071] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.094071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.094071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.094071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.094071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.094071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.094808] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.095644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.095818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.095984] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.096122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.096174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.096309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.096400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.096486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.096571] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.405778] env[62620]: INFO networking_nsxv3.common.synchronization [req-67ae8d3c-a51a-44e1-87e6-08c82ce6c4f0 req-2661fe86-ce90-4a6c-a72e-d4d42d055782 tempest-ServerExternalEventsTest-1806940606 tempest-ServerExternalEventsTest-1806940606-project-member] Enqueued Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGHEST for action security_group_members [ 873.406891] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGHEST for action security_group_members [ 873.406891] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5648415-b62c-4796-a92a-229b5e585bfa taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.410656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.410776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.411013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.411220] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.411334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.411511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.411625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.411727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.411827] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5648415-b62c-4796-a92a-229b5e585bfa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.540233] env[62620]: INFO networking_nsxv3.common.synchronization [req-21a35e0b-f9d4-4a7b-9e00-133a788fa523 req-f71a6910-c938-488a-8344-31ba91e6d471 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 873.540752] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 873.541060] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.541183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.541275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.541446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.541667] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.541760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.541760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.541889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.541974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.542191] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.573053] env[62620]: INFO networking_nsxv3.common.synchronization [req-21a35e0b-f9d4-4a7b-9e00-133a788fa523 req-f71a6910-c938-488a-8344-31ba91e6d471 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 873.573302] env[62620]: INFO networking_nsxv3.common.synchronization [req-21a35e0b-f9d4-4a7b-9e00-133a788fa523 req-f71a6910-c938-488a-8344-31ba91e6d471 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 873.573469] env[62620]: INFO networking_nsxv3.common.synchronization [req-21a35e0b-f9d4-4a7b-9e00-133a788fa523 req-f71a6910-c938-488a-8344-31ba91e6d471 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf with Priority: HIGHEST for action port [ 873.574284] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 873.574428] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 873.574560] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf with Priority: HIGHEST for action port [ 873.576375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.576375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.576375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.576375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.576375] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.577166] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.577166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.577166] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-5db92929-a96d-41c2-be2b-95c9ef62c4bf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.577368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.577368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.577542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.577618] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db92929-a96d-41c2-be2b-95c9ef62c4bf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.597952] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.598141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.598234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.598493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.598724] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.598851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.598924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.599098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.599191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.599280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.599431] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.599549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.599641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.599802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.600018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.600139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.600214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.600395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.600551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.600669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.600766] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.602403] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.914676] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.914990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.915338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.915704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.915860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.916147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.916243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.916312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.916490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.916579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.916669] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5648415-b62c-4796-a92a-229b5e585bfa is going to be updated. [ 873.948903] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.949162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.949162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.949272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.949652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.958996] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5648415-b62c-4796-a92a-229b5e585bfa in Status: IN_PROGRESS for 2s [ 873.993088] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 873.993344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.044464] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.082359] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.083112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.085325] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5db92929-a96d-41c2-be2b-95c9ef62c4bf with status ACTIVE [ 874.085569] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.085708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.085798] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.086063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.086209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.086403] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.086515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.086583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.086742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.086820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.087016] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.087113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.087176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.089751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.089889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.090021] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf is going to be updated. [ 874.103656] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daf462fc-bab6-4357-af22-b6d35dd411dd: rpc.has_security_group_logging(os_id): False [ 874.104856] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8623cf30-8f12-4744-a839-bb17de78b876: rpc.has_security_group_logging(os_id): False [ 874.119364] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.119488] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.119566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.119774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.119917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.120085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.134081] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.134246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.134300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.134510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.134595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.134780] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.134911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.134948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.135117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.135193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.135375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.135465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.135524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.135662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.135732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.135920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.138973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.138973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.138973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.138973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.138973] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 874.140612] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.140725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.140792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.141035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.141035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.141266] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.141403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.141455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.141566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.141639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.141746] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8623cf30-8f12-4744-a839-bb17de78b876 is going to be created. [ 874.242329] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.242474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.242545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.242781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.242919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.259230] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.259230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.259230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.259230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.259230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.261558] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: IN_PROGRESS for 2s [ 874.266230] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 874.266230] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 874.266230] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 with Priority: HIGHEST for action security_group_members [ 874.266230] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 874.266230] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 874.266230] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 with Priority: HIGHEST for action security_group_members [ 874.266230] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.266230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.266230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.266846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.267013] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.267164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.267254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.267454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.267571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.267690] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.268527] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.268840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.268840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.268975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.269556] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.269556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.269556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.269556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.269556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.269894] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.270523] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-74bbf32e-09d7-454b-b03b-d92fd2b59665 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.270664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.270769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.271489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.271489] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.271489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.271489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.271489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.271673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.271703] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.273151] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 874.354906] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 with Priority: HIGHEST for action security_group_rules [ 874.355128] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 with Priority: HIGHEST for action security_group_members [ 874.355273] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_rules [ 874.355405] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 874.355590] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 874.355669] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 874.355773] env[62620]: INFO networking_nsxv3.common.synchronization [req-734480be-0344-47d8-867b-729640aebfae req-e8dd9905-a851-40d3-b21e-547954a08476 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: bf72690a-0358-469d-8d21-85ef459cbcb9 with Priority: HIGHEST for action port [ 874.356522] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 with Priority: HIGHEST for action security_group_rules [ 874.356522] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_rules [ 874.356522] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 874.356716] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf72690a-0358-469d-8d21-85ef459cbcb9 with Priority: HIGHEST for action port [ 874.356716] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_rules [ 874.356876] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 with Priority: HIGHEST for action security_group_members [ 874.356876] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 874.358286] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74bbf32e-09d7-454b-b03b-d92fd2b59665 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.358286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.358286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.358286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.358286] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.358558] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.358558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.358736] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.358819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.358992] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf72690a-0358-469d-8d21-85ef459cbcb9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.359100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.359165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.359325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.359398] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf72690a-0358-469d-8d21-85ef459cbcb9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.360549] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.360633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.360814] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-74bbf32e-09d7-454b-b03b-d92fd2b59665 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.360941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.361101] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.361157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.509371] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a6af52c-b1fd-4489-b26c-557260173089 in Status: SUCCESS [ 874.509669] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a6af52c-b1fd-4489-b26c-557260173089 deletion is rescheduled due to dependency. [ 874.514177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.547401] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.774547] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.775807] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.776476] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.862387] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-74bbf32e-09d7-454b-b03b-d92fd2b59665 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.862532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.862673] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf72690a-0358-469d-8d21-85ef459cbcb9 with status ACTIVE [ 874.862836] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.862937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.862998] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.863222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.863305] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.863481] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.863571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.863630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.863789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.864109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.864308] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.864413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.864474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.865448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.865501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.865751] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf72690a-0358-469d-8d21-85ef459cbcb9 is going to be updated. [ 874.887759] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.887923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.887980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.888283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.888434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.888589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf72690a-0358-469d-8d21-85ef459cbcb9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.051161] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.051161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.051161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.051161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.051161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.051161] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be updated. [ 875.089119] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.089119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.089119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.089119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.089119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.096796] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: IN_PROGRESS for 2s [ 875.278052] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.279264] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.279892] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.780720] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.781098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.781098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.781289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.781372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.781496] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 875.783751] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.783751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.783751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.783751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.783751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.783751] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623cf30-8f12-4744-a839-bb17de78b876 is going to be updated. [ 875.784561] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.784644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.784689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.784858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.784911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.784986] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 is going to be created. [ 875.806945] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.807121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.807196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.807485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.807584] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.809577] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.809577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.809689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.810669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.810669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.813070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.813194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.813264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.813435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.813647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.824171] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: IN_PROGRESS for 2s [ 875.824835] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 875.825396] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 in Status: UNINITIALIZED for 2s [ 875.968873] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5648415-b62c-4796-a92a-229b5e585bfa in Status: SUCCESS [ 875.969079] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5648415-b62c-4796-a92a-229b5e585bfa deletion is rescheduled due to dependency. [ 875.969340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.272951] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: SUCCESS [ 876.273200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.274401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.274649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.274743] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.288839] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 876.289244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.289244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.289432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.289516] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.777953] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.778122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.793697] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.794085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.001737] env[62620]: INFO networking_nsxv3.common.synchronization [req-c0052d87-8acd-4c6a-b3c4-830226a12253 req-e447a9f4-54e3-449b-95d2-c294caaa7a00 tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 877.001737] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 877.002214] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.003751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.003899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.005032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.005032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.005032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.005032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.005032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.005032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.005347] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.112915] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: SUCCESS [ 877.113031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.115027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.115027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.115027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.115027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.115027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.115027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.115027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.115027] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.510598] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.510891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.510891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.510986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.511054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.512138] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.512300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.512369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.512565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.512654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.512746] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 255ec5a6-942e-49be-b759-c091160337f6 already deleted. [ 877.512830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.617398] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.836925] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 in Status: SUCCESS [ 877.837526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.837769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.839066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.839066] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.839066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.839066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.839251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.840929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.840929] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.843423] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 877.843650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.844514] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: SUCCESS [ 877.845411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.845411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.845750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.846032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.846194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.846575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.846960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.847105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.847235] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.849124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.849124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.849124] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.849472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.849472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.850135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.850263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.850383] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.120810] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.168650] env[62620]: INFO networking_nsxv3.common.synchronization [req-c6ae5c6a-8ece-482b-bb89-2f6bb3f66ec8 req-92e8abf5-bafc-460d-9f27-92357dd9e2fb tempest-ServersTestJSON-774440597 tempest-ServersTestJSON-774440597-project-member] Enqueued Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_members [ 878.168852] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGHEST for action security_group_members [ 878.169217] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-341c1f60-30e8-4cc4-ae8a-741cd6542553 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.169389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.169389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.169596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.169740] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.169835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.169908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.170205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.170205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.170396] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.250450] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.250650] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.250776] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.251136] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.251399] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.251557] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.251683] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.251883] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.252857] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.253175] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.253318] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.253440] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.253556] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.253694] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.254177] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.254372] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.275285] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.275427] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 878.275573] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.275755] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.276111] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-b0e730ac-28a5-40f0-bbe1-c4f48f060624 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.276283] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-b0e730ac-28a5-40f0-bbe1-c4f48f060624" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.276409] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-b0e730ac-28a5-40f0-bbe1-c4f48f060624" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.276767] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-b0e730ac-28a5-40f0-bbe1-c4f48f060624" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.276910] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e730ac-28a5-40f0-bbe1-c4f48f060624',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.353217] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.354645] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.355374] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.394710] env[62620]: INFO networking_nsxv3.common.synchronization [req-180fbcdf-5aef-4b23-82a8-3df0fcb40b1f req-c045802a-2b19-4942-a4b5-7333e84d7394 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 878.394710] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 878.396341] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.396341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.425809] env[62620]: INFO networking_nsxv3.common.synchronization [req-180fbcdf-5aef-4b23-82a8-3df0fcb40b1f req-c045802a-2b19-4942-a4b5-7333e84d7394 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 878.425809] env[62620]: INFO networking_nsxv3.common.synchronization [req-180fbcdf-5aef-4b23-82a8-3df0fcb40b1f req-c045802a-2b19-4942-a4b5-7333e84d7394 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 878.425809] env[62620]: INFO networking_nsxv3.common.synchronization [req-180fbcdf-5aef-4b23-82a8-3df0fcb40b1f req-c045802a-2b19-4942-a4b5-7333e84d7394 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf with Priority: HIGHEST for action port [ 878.425809] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_rules [ 878.425809] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 878.425809] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf with Priority: HIGHEST for action port [ 878.425809] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.425809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.426274] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.426274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.426529] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-5db92929-a96d-41c2-be2b-95c9ef62c4bf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.426710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.426791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.429018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.429018] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db92929-a96d-41c2-be2b-95c9ef62c4bf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.623880] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.624071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.624185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.624419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.627180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.627180] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be updated. [ 878.655867] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.655987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.656088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.656671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.656885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.666761] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: IN_PROGRESS for 2s [ 878.672319] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.675261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.675261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.675261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.695141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.695141] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.695141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.695141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.697022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.697022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.697022] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 is going to be updated. [ 878.725775] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.725775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.725775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.725775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.725775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.733076] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 in Status: IN_PROGRESS for 2s [ 878.782773] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.782773] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.782773] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.783033] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.783133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.783291] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port b0e730ac-28a5-40f0-bbe1-c4f48f060624 not found, creating... [ 878.783594] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.783748] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.783865] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.784164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.784301] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.784620] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.784776] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.784898] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.791208] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.791208] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.791208] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: b0e730ac-28a5-40f0-bbe1-c4f48f060624 is going to be created. [ 878.810474] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.810922] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.811083] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.811401] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.811774] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.812161] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-b0e730ac-28a5-40f0-bbe1-c4f48f060624" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.858448] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.861465] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.861465] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.867191] env[62620]: INFO networking_nsxv3.common.synchronization [req-f8acef66-d09b-4cf5-a130-55c74245bf6a req-7ee36ae2-671d-49fa-859c-0991a456b6ff tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 878.868100] env[62620]: INFO networking_nsxv3.common.synchronization [req-f8acef66-d09b-4cf5-a130-55c74245bf6a req-7ee36ae2-671d-49fa-859c-0991a456b6ff tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 878.868100] env[62620]: INFO networking_nsxv3.common.synchronization [req-f8acef66-d09b-4cf5-a130-55c74245bf6a req-7ee36ae2-671d-49fa-859c-0991a456b6ff tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 with Priority: HIGHEST for action security_group_members [ 878.868100] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGHEST for action security_group_members [ 878.868310] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 878.868310] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 with Priority: HIGHEST for action security_group_members [ 878.868750] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.868850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.869011] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.869121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.869401] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-74bbf32e-09d7-454b-b03b-d92fd2b59665 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.869536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.929032] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5db92929-a96d-41c2-be2b-95c9ef62c4bf with status ACTIVE [ 878.929306] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.929450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.929554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.933026] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.933026] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.933026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.933026] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5db92929-a96d-41c2-be2b-95c9ef62c4bf is going to be updated. [ 878.962151] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.962292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.962361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.962567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.962693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.962871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5db92929-a96d-41c2-be2b-95c9ef62c4bf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.367023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.367023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.367023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.367023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.367023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.367023] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 is going to be updated. [ 879.367023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.367023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.367023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.367023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.367023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.367023] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 879.369804] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.370796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.370796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.370796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.370796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.371290] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623cf30-8f12-4744-a839-bb17de78b876 is going to be updated. [ 879.401463] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.409030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.409030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.409030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.409030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.409788] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.409916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.409916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.410181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.410342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.414898] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.414898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.414898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.414898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.414898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.426107] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: IN_PROGRESS for 2s [ 879.428940] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 in Status: IN_PROGRESS for 2s [ 879.429824] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 879.557022] env[62620]: INFO networking_nsxv3.common.synchronization [None req-74cc2ae6-7c10-4bfa-9ed2-137324cb9edd None None] Enqueued Resource ID: 241db366-7f09-44f6-b568-d5abc4fd99e2 with Priority: HIGHEST for action port [ 879.557022] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241db366-7f09-44f6-b568-d5abc4fd99e2 with Priority: HIGHEST for action port [ 879.557022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-241db366-7f09-44f6-b568-d5abc4fd99e2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.557022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-241db366-7f09-44f6-b568-d5abc4fd99e2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.557022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-241db366-7f09-44f6-b568-d5abc4fd99e2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.557022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-241db366-7f09-44f6-b568-d5abc4fd99e2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.557434] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('241db366-7f09-44f6-b568-d5abc4fd99e2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.850187] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-a48d8fd6-1712-4dd5-919a-b18a89384c5c tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 879.850187] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 879.850389] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.850506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.850574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.850823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.851215] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.854402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.854578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.854804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.855464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.855464] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.059988] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 241db366-7f09-44f6-b568-d5abc4fd99e2 [ 880.060271] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.060343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.061018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.061018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.061018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.061018] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:241db366-7f09-44f6-b568-d5abc4fd99e2 already deleted. [ 880.061018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-241db366-7f09-44f6-b568-d5abc4fd99e2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.355527] env[62620]: INFO networking_nsxv3.common.synchronization [req-c0052d87-8acd-4c6a-b3c4-830226a12253 req-0db36c31-646e-46a8-ad69-49a19ef7b255 service nova] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_rules [ 880.355741] env[62620]: INFO networking_nsxv3.common.synchronization [req-c0052d87-8acd-4c6a-b3c4-830226a12253 req-0db36c31-646e-46a8-ad69-49a19ef7b255 service nova] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 880.355883] env[62620]: INFO networking_nsxv3.common.synchronization [req-c0052d87-8acd-4c6a-b3c4-830226a12253 req-0db36c31-646e-46a8-ad69-49a19ef7b255 service nova] Enqueued Resource ID: b0e730ac-28a5-40f0-bbe1-c4f48f060624 with Priority: HIGHEST for action port [ 880.356135] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_rules [ 880.356424] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 880.356424] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0e730ac-28a5-40f0-bbe1-c4f48f060624 with Priority: HIGHEST for action port [ 880.356944] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.360363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.360472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.360719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.360827] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.362667] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.366023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.366023] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.366023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0e730ac-28a5-40f0-bbe1-c4f48f060624 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0e730ac-28a5-40f0-bbe1-c4f48f060624" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0e730ac-28a5-40f0-bbe1-c4f48f060624" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.366023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0e730ac-28a5-40f0-bbe1-c4f48f060624" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.366023] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e730ac-28a5-40f0-bbe1-c4f48f060624',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.366778] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.366778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.366778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.366979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.366979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.367786] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.367786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.367786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.367786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.367786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.367786] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e already deleted. [ 880.367786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.677033] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: SUCCESS [ 880.677033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.677033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.677033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.677422] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.677422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.677422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.677550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.677929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.677929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.677929] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.678884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.678884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.679008] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.679294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.679294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.679436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.679532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.679636] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.743026] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 in Status: SUCCESS [ 880.743026] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 deletion is rescheduled due to dependency. [ 880.743026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.867765] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.867765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.870076] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.870723] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0e730ac-28a5-40f0-bbe1-c4f48f060624 with status ACTIVE [ 880.870914] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.871040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.871118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.871349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.871432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.871640] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.871708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.871823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.871943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.871984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.872446] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.872446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.872547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.872868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.872868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.872868] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0e730ac-28a5-40f0-bbe1-c4f48f060624 is going to be updated. [ 880.877346] env[62620]: INFO networking_nsxv3.common.synchronization [req-1cc79297-9247-48f6-a865-8013b5aef85c req-8f18c929-d30a-4d69-abda-1700dcf2a28e tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 880.877346] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 880.877608] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.877608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.877705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.878723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.881423] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.881679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.881773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.881984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.882143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.882235] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.895129] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.895318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.895424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.895551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.895689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.895943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0e730ac-28a5-40f0-bbe1-c4f48f060624" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.181481] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.182457] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.230386] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-8b36ca0e-7c07-471e-96c8-f66186939909 tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 881.230901] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 881.231256] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.231339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.231410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.231641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.231795] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.232127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.232127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.235395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.235395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.235395] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.377298] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.385207] env[62620]: INFO networking_nsxv3.common.synchronization [None req-5a6cc44d-02fd-40c9-a279-974f7c672b68 None None] Enqueued Resource ID: 06c3e8cf-dd02-4e4c-b982-058c6393e10e with Priority: HIGHEST for action port [ 881.385207] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c3e8cf-dd02-4e4c-b982-058c6393e10e with Priority: HIGHEST for action port [ 881.385427] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-06c3e8cf-dd02-4e4c-b982-058c6393e10e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.385554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06c3e8cf-dd02-4e4c-b982-058c6393e10e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.385626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06c3e8cf-dd02-4e4c-b982-058c6393e10e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.385912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06c3e8cf-dd02-4e4c-b982-058c6393e10e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.386025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06c3e8cf-dd02-4e4c-b982-058c6393e10e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.391216] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.391216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.391591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.391885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.392066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.392326] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.392476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.392568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.392830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.392929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.393046] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be updated. [ 881.439075] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.439251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.439327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.439639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.439688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.441325] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: SUCCESS [ 881.442385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.442385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.442385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.442385] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.442385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.442385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.442697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.442697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.442697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.442784] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.445833] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 881.445833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.445833] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 in Status: SUCCESS [ 881.445833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.446446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.446446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.446446] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.446552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.446552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.446768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.446825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.447308] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.447671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.447862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.451021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.451021] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.451021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.451021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.454144] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.454294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.454419] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.456690] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 881.457180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.457348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.457557] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.457664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.457746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.457877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.457955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.458072] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.459358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.459358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.459464] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.459563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.459623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.459760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.459843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.460675] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.460675] env[62620]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 881.685524] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5055d880-77be-4c89-8a2a-a2e60908e12a: rpc.has_security_group_logging(os_id): False [ 881.687041] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.705214] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.705377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.705417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.705616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.724112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.724112] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.724316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.724484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.725692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.725894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.726054] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be updated. [ 881.734985] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.738212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.738292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.738510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.738602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.738820] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.738930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.738990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.739163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.739244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.739331] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e already deleted. [ 881.739557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.781523] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.784026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.784026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.784026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.784026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.807814] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: IN_PROGRESS for 2s [ 881.882643] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.882827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.882953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.883210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.883295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.883368] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 255ec5a6-942e-49be-b759-c091160337f6 is going to be created. [ 881.888867] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06c3e8cf-dd02-4e4c-b982-058c6393e10e [ 881.888867] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.889200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.889200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.889447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.889447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.889639] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06c3e8cf-dd02-4e4c-b982-058c6393e10e already deleted. [ 881.889639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06c3e8cf-dd02-4e4c-b982-058c6393e10e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.925249] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.925475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.925874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.925874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.926099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.941314] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: UNINITIALIZED for 2s [ 881.957942] env[62620]: INFO networking_nsxv3.common.synchronization [None req-4423c2ba-eda9-4e4b-a5d1-7b0e34776de3 tempest-ServersTestManualDisk-1682543278 tempest-ServersTestManualDisk-1682543278-project-member] Enqueued Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_rules [ 881.957942] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.957942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.957942] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.963507] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.963507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.963507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.963507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.963507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.963507] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.963820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.963820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.963820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.963910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.963940] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623cf30-8f12-4744-a839-bb17de78b876 is going to be updated. [ 881.966890] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_rules [ 881.967600] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.968314] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.968424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.968489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.968663] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.968743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.968919] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.969028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.969138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.969227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.969299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.969380] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 is going to be deleted. [ 881.971546] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9338b344-e20e-4f2c-889d-3246eaae326d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.971731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.972409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.972409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.972409] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.975365] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74bbf32e-09d7-454b-b03b-d92fd2b59665',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.005195] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.005435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.005544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.005854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.005995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.008771] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.008771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.008771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.008771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.008771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.008771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.015458] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: IN_PROGRESS for 2s [ 882.190635] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.191875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.191875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.191875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.191875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.191875] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be updated. [ 882.241795] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.242169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.242169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.242405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.242555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.255234] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: IN_PROGRESS for 2s [ 882.294947] env[62620]: INFO networking_nsxv3.common.synchronization [None req-ce3984d2-f61f-4791-a49a-4b73c93e0ff2 tempest-ServersTestManualDisk-1682543278 tempest-ServersTestManualDisk-1682543278-project-member] Enqueued Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_rules [ 882.295860] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_rules [ 882.295860] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9338b344-e20e-4f2c-889d-3246eaae326d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.295860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.301930] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-7c682f99-42fc-43c0-8ae7-54255a5be97b tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 882.303245] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 882.303696] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.304316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.304316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.304316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.304497] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.305189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.305264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.305480] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.305583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.305867] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.468937] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8623cf30-8f12-4744-a839-bb17de78b876: rpc.has_security_group_logging(os_id): False [ 882.475901] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.483371] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74bbf32e-09d7-454b-b03b-d92fd2b59665: rpc.has_security_group_logging(os_id): False [ 882.491387] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.491387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.491387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.491387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.491387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.491387] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.491387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.491387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.491387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.491387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.491387] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8623cf30-8f12-4744-a839-bb17de78b876 is going to be updated. [ 882.508625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.508625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.508625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.508867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.509361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.509361] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.509361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.509361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.509526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.509604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.509645] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 is going to be created. [ 882.513032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.513223] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.513485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.513653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.513776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.513896] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9338b344-e20e-4f2c-889d-3246eaae326d already deleted. [ 882.514216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.514956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.515239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.515530] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.530761] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/74bbf32e-09d7-454b-b03b-d92fd2b59665], does not exist path=[/infra/domains/default/groups/74bbf32e-09d7-454b-b03b-d92fd2b59665]."\n}' [ 882.530871] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/74bbf32e-09d7-454b-b03b-d92fd2b59665 [ 882.530954] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 882.551095] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.551510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.551604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.551921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.552173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.563413] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: IN_PROGRESS for 2s [ 882.566213] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.566348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.566426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.566617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.567606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.568174] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.568174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.568309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.568660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.568751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.569093] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.569951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.570162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.570229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.570278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.571874] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74bbf32e-09d7-454b-b03b-d92fd2b59665 is going to be created. [ 882.587928] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/74bbf32e-09d7-454b-b03b-d92fd2b59665], does not exist path=[/infra/domains/default/groups/74bbf32e-09d7-454b-b03b-d92fd2b59665]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/74bbf32e-09d7-454b-b03b-d92fd2b59665 [ 882.587928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74bbf32e-09d7-454b-b03b-d92fd2b59665" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.587928] env[62620]: Traceback (most recent call last): [ 882.587928] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 882.587928] env[62620]: return func(*args, **kwargs) [ 882.587928] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 882.587928] env[62620]: res.raise_for_status() [ 882.587928] env[62620]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 882.587928] env[62620]: raise HTTPError(http_error_msg, response=self) [ 882.587928] env[62620]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/74bbf32e-09d7-454b-b03b-d92fd2b59665 [ 882.587928] env[62620]: During handling of the above exception, another exception occurred: [ 882.587928] env[62620]: Traceback (most recent call last): [ 882.587928] env[62620]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 882.587928] env[62620]: listener.cb(fileno) [ 882.587928] env[62620]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 882.587928] env[62620]: result = function(*args, **kwargs) [ 882.587928] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 882.587928] env[62620]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 882.587928] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 882.587928] env[62620]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 882.587928] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 882.587928] env[62620]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 882.587928] env[62620]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 882.587928] env[62620]: res.raise_for_status() [ 882.587928] env[62620]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 882.587928] env[62620]: raise HTTPError(http_error_msg, response=self) [ 882.587928] env[62620]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/74bbf32e-09d7-454b-b03b-d92fd2b59665 [ 882.587928] env[62620]: Removing descriptor: 30 [ 882.789289] env[62620]: INFO networking_nsxv3.common.synchronization [req-1eb60e4c-b8cc-4684-ab98-b93d27b9eb65 req-1bc6a44d-7071-44ec-ae69-c96665562ed2 tempest-MultipleCreateTestJSON-1897705394 tempest-MultipleCreateTestJSON-1897705394-project-member] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 882.789712] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 882.790301] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.790636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.790836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.791185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.791489] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.791781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.792203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.792352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.792589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.794069] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.809770] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.809770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.809770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.809770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.809770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.809770] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.809770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.809770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.809770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.809770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.809770] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e already deleted. [ 882.809770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.946516] env[62620]: INFO networking_nsxv3.common.synchronization [None req-0ac2a053-26ce-4493-9b94-07801b21aa22 None None] Enqueued Resource ID: aa9bedb8-de36-4540-b9ab-2501b3469768 with Priority: HIGHEST for action port [ 882.946516] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa9bedb8-de36-4540-b9ab-2501b3469768 with Priority: HIGHEST for action port [ 882.946516] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa9bedb8-de36-4540-b9ab-2501b3469768 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.946516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa9bedb8-de36-4540-b9ab-2501b3469768" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.946516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa9bedb8-de36-4540-b9ab-2501b3469768" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.947202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa9bedb8-de36-4540-b9ab-2501b3469768" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.947762] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa9bedb8-de36-4540-b9ab-2501b3469768',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.980337] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.981626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.981626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.981626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.981626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.981626] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 883.007626] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.007845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.008041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.008365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.008808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.017979] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 883.034777] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.034962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.035037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.035324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.035430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.035471] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9338b344-e20e-4f2c-889d-3246eaae326d already deleted. [ 883.035564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.295648] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.296113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.296113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.296238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.315928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.316219] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.316378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.316448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.316677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.316757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.316825] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 883.344765] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.344765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.344765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.344765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.344765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.353579] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 883.449600] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa9bedb8-de36-4540-b9ab-2501b3469768 [ 883.450035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.450147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.450224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.451051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.451152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.451264] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa9bedb8-de36-4540-b9ab-2501b3469768 already deleted. [ 883.451351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa9bedb8-de36-4540-b9ab-2501b3469768" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.471734] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 883.471734] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 deletion is rescheduled due to dependency. [ 883.471734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.558040] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.558040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-167" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.558040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-167" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.558040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-167" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.558040] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.558040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.558040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.558040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.558040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.558040] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.558040] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.558040] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.558654] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.558654] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.558654] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.558654] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.575188] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.575412] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 883.575595] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.578849] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-167" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.578849] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.578849] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.578849] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.578849] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.578849] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bf6cde4-6fe7-4f05-a8ed-b57e621b565b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.829330] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: SUCCESS [ 883.829607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.832043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.832043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.832043] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.952060] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: SUCCESS [ 883.952219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.952449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.955319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.955588] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.955699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.955737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.955955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.956072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.956173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.956369] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.026295] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: SUCCESS [ 884.026295] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623cf30-8f12-4744-a839-bb17de78b876 deletion is rescheduled due to dependency. [ 884.026295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.081743] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.084209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.084209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.084209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.084209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.084209] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 6bf6cde4-6fe7-4f05-a8ed-b57e621b565b not found, creating... [ 884.084209] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.084209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.084209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.084209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.084209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.085626] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.086216] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.086498] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.086929] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.089052] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.089052] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 6bf6cde4-6fe7-4f05-a8ed-b57e621b565b is going to be created. [ 884.108220] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.108220] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.108220] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.108220] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.108220] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.108220] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.265472] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: SUCCESS [ 884.265472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.265472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.267025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.267025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.267025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.267025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.267025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.267025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.267025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.332972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.333688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.421887] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.421887] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.421887] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.421887] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.421887] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.421887] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.421887] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.421887] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.421887] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.421887] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.421887] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.421887] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.421887] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.422374] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.422374] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.422374] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.440163] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.440424] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.440424] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.440805] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.441351] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-40b19e0d-048f-4bca-bfea-412ad98b0568 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.441807] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-40b19e0d-048f-4bca-bfea-412ad98b0568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.441947] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-40b19e0d-048f-4bca-bfea-412ad98b0568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.442347] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-40b19e0d-048f-4bca-bfea-412ad98b0568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.442495] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40b19e0d-048f-4bca-bfea-412ad98b0568',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.465477] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.577408] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8623cf30-8f12-4744-a839-bb17de78b876 in Status: SUCCESS [ 884.577408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.771240] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.946162] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.946162] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.946346] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.946764] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.947029] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.947445] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 40b19e0d-048f-4bca-bfea-412ad98b0568 not found, creating... [ 884.947754] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.951523] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.951793] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.952255] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.952478] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.953806] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.953806] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.953806] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.954211] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.954266] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.954614] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 40b19e0d-048f-4bca-bfea-412ad98b0568 is going to be created. [ 884.967050] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 255ec5a6-942e-49be-b759-c091160337f6: rpc.has_security_group_logging(os_id): False [ 884.990454] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.990773] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.990993] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.991330] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.991628] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.992605] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-40b19e0d-048f-4bca-bfea-412ad98b0568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.997818] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.997818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.997920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.998163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.998261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.998543] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.998664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.998734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.998928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.999020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.999260] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 255ec5a6-942e-49be-b759-c091160337f6 is going to be created. [ 885.030338] env[62620]: INFO networking_nsxv3.common.synchronization [req-c78c57c4-3f40-4788-a7ae-32d7a8a29f92 req-50dda5f2-7073-48cc-a712-07abbee4adc8 tempest-AttachInterfacesUnderV243Test-1545049479 tempest-AttachInterfacesUnderV243Test-1545049479-project-member] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 885.032422] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 885.032422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.032422] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGHEST for action security_group_members [ 885.032422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.032422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.032649] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.032834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.032893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.033150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.034395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.034395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.034395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.034395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.034395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.034395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.034395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.034805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.034805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.034805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.034805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.034907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.035898] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.038385] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.038385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.068433] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.072093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.072093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.072093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.072093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.099114] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: IN_PROGRESS for 2s [ 885.273225] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.371021] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 885.371021] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 deletion is rescheduled due to dependency. [ 885.371021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.490533] env[62620]: INFO networking_nsxv3.common.synchronization [req-1eb60e4c-b8cc-4684-ab98-b93d27b9eb65 req-f83e3a22-477d-417c-9e2e-f54eb84beceb tempest-MultipleCreateTestJSON-1897705394 tempest-MultipleCreateTestJSON-1897705394-project-member] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 885.491243] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 885.491494] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.491688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.491763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.494103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.494103] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.494103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.494103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.494103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.494103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.494103] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.539634] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daf462fc-bab6-4357-af22-b6d35dd411dd: rpc.has_security_group_logging(os_id): False [ 885.542649] env[62620]: INFO networking_nsxv3.common.synchronization [None req-22ee9fc7-a9ec-4c34-978e-90c59d1a7a0a None None] Enqueued Resource ID: 04828ca1-d184-4f65-9dc7-f7cf15ba2149 with Priority: HIGHEST for action port [ 885.543667] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04828ca1-d184-4f65-9dc7-f7cf15ba2149 with Priority: HIGHEST for action port [ 885.545087] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-04828ca1-d184-4f65-9dc7-f7cf15ba2149 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.545087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04828ca1-d184-4f65-9dc7-f7cf15ba2149" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.545087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04828ca1-d184-4f65-9dc7-f7cf15ba2149" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.545384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04828ca1-d184-4f65-9dc7-f7cf15ba2149" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.545384] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04828ca1-d184-4f65-9dc7-f7cf15ba2149',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.560496] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.560768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.560915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.561243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.579856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.580062] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.580210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.580249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.580556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.580556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.580707] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.581189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.581189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.581189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.581189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.581369] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.581563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.581653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.581820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.581920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.582040] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 885.618718] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-ecae7841-3ab2-4901-a8fa-90eeebe066be service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 885.620034] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-ecae7841-3ab2-4901-a8fa-90eeebe066be service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 885.620034] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-ecae7841-3ab2-4901-a8fa-90eeebe066be service nova] Enqueued Resource ID: 6bf6cde4-6fe7-4f05-a8ed-b57e621b565b with Priority: HIGHEST for action port [ 885.620034] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 885.620034] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 885.620034] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf6cde4-6fe7-4f05-a8ed-b57e621b565b with Priority: HIGHEST for action port [ 885.620267] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.621241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.621241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.621241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.621241] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.621762] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.621900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.621978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.622163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.622337] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.622434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.622493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.622632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.622716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.622795] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.623512] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.623610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.623674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.623818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.623888] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bf6cde4-6fe7-4f05-a8ed-b57e621b565b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.639174] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.641651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.641651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.641651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.641651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.672027] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 885.776056] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.776345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.776831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.777220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.777324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.777435] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be updated. [ 885.816595] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.816787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.817033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.817502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.817648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.827472] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: IN_PROGRESS for 2s [ 885.903244] env[62620]: INFO networking_nsxv3.common.synchronization [req-560d8d6b-edca-4ab2-af38-da0c63ca679e req-757ab8e8-8d04-4f5c-8814-c2eb3e5b7c39 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_members [ 885.903826] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGHEST for action security_group_members [ 885.906049] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.906302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.906396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.907051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.907213] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.907424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.907424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.907582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.907649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.907713] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.995343] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.995585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.995719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.996036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.996220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.996483] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.996606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.996673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.996862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.996947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.997070] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 886.026193] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.026430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.026545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.026788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.026937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.036777] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 886.047776] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04828ca1-d184-4f65-9dc7-f7cf15ba2149 [ 886.048226] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.048488] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.048805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.049165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.049355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.049728] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04828ca1-d184-4f65-9dc7-f7cf15ba2149 already deleted. [ 886.049728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04828ca1-d184-4f65-9dc7-f7cf15ba2149" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.125970] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.127029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.127029] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.127466] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bf6cde4-6fe7-4f05-a8ed-b57e621b565b with status ACTIVE [ 886.127721] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.129382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.129382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.129972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.130096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.130375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.131313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.132083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.132083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.132083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.132083] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.132814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.133225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.133225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.133369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.133369] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bf6cde4-6fe7-4f05-a8ed-b57e621b565b is going to be updated. [ 886.157886] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.158341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.158660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.158911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.161222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.161407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bf6cde4-6fe7-4f05-a8ed-b57e621b565b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.272383] env[62620]: INFO networking_nsxv3.common.synchronization [req-1eb60e4c-b8cc-4684-ab98-b93d27b9eb65 req-efa83ff2-ad22-4ad8-a31f-226f283e8280 service nova] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_rules [ 886.272510] env[62620]: INFO networking_nsxv3.common.synchronization [req-1eb60e4c-b8cc-4684-ab98-b93d27b9eb65 req-efa83ff2-ad22-4ad8-a31f-226f283e8280 service nova] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 886.272744] env[62620]: INFO networking_nsxv3.common.synchronization [req-1eb60e4c-b8cc-4684-ab98-b93d27b9eb65 req-efa83ff2-ad22-4ad8-a31f-226f283e8280 service nova] Enqueued Resource ID: 40b19e0d-048f-4bca-bfea-412ad98b0568 with Priority: HIGHEST for action port [ 886.273063] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_rules [ 886.273251] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 886.273895] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b19e0d-048f-4bca-bfea-412ad98b0568 with Priority: HIGHEST for action port [ 886.278741] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.278741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.278741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.278741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.278741] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.278741] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.278741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.278741] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-40b19e0d-048f-4bca-bfea-412ad98b0568 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.278741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40b19e0d-048f-4bca-bfea-412ad98b0568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.278741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40b19e0d-048f-4bca-bfea-412ad98b0568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.278741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40b19e0d-048f-4bca-bfea-412ad98b0568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.278741] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40b19e0d-048f-4bca-bfea-412ad98b0568',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.299713] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.299713] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.299713] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.299852] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.300684] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.300684] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.300684] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.300684] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.300874] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.300973] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.301046] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.301157] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.301357] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.301493] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.301606] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.301742] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.325411] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.325631] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 886.325763] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.325945] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-852" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.326345] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-93a8b363-e41a-4ac2-abf1-274395673a5b taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.326531] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-93a8b363-e41a-4ac2-abf1-274395673a5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.326658] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-93a8b363-e41a-4ac2-abf1-274395673a5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.327047] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-93a8b363-e41a-4ac2-abf1-274395673a5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.327146] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93a8b363-e41a-4ac2-abf1-274395673a5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.413076] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.413076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.413076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.413076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.455394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.455878] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.458262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.458262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.458262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.458262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.458262] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 is going to be updated. [ 886.493181] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.493181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.493181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.493181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.493181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.502579] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 in Status: IN_PROGRESS for 2s [ 886.635257] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.669634] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.669830] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.669958] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.670363] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.670606] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.670789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.670881] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.674449] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.674689] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.675058] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.675260] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.675924] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.675924] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.675924] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.675924] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.676473] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.710453] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.710697] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 886.710856] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.711863] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.712344] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-e9aeb5b9-eeec-406e-a7d0-6207531ec459 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.712546] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-e9aeb5b9-eeec-406e-a7d0-6207531ec459" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.712689] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-e9aeb5b9-eeec-406e-a7d0-6207531ec459" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.713836] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-e9aeb5b9-eeec-406e-a7d0-6207531ec459" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.714027] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9aeb5b9-eeec-406e-a7d0-6207531ec459',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.783884] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.784020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.784994] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40b19e0d-048f-4bca-bfea-412ad98b0568 with status ACTIVE [ 886.785221] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.785349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.785420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.786775] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.786775] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.786775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.787797] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40b19e0d-048f-4bca-bfea-412ad98b0568 is going to be updated. [ 886.807586] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.807586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.807586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.807720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.807867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.808043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40b19e0d-048f-4bca-bfea-412ad98b0568" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.829771] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.830208] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.830290] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.830656] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.830786] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.830943] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 93a8b363-e41a-4ac2-abf1-274395673a5b not found, creating... [ 886.831250] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.831518] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.831581] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.831801] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.831942] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.832238] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.832399] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.832519] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.832729] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.832866] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.833017] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 93a8b363-e41a-4ac2-abf1-274395673a5b is going to be created. [ 886.867499] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.869185] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.869185] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.869185] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.869185] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.869185] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-93a8b363-e41a-4ac2-abf1-274395673a5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.112760] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: SUCCESS [ 887.113048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.138773] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.138773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.138773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.138946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.139052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.139125] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be created. [ 887.165774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.165774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.165774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.165774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.166256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.181699] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: UNINITIALIZED for 2s [ 887.217258] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.217517] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.217645] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.217990] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.218449] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.218449] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port e9aeb5b9-eeec-406e-a7d0-6207531ec459 not found, creating... [ 887.218715] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.218792] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.218931] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.219516] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.219516] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.219698] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.219902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.221592] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.221592] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.221592] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.221592] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: e9aeb5b9-eeec-406e-a7d0-6207531ec459 is going to be created. [ 887.254844] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.255082] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.255709] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.255709] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.255801] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.256043] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-e9aeb5b9-eeec-406e-a7d0-6207531ec459" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.689805] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 887.690449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.790771] env[62620]: INFO networking_nsxv3.common.synchronization [req-bf808392-fe5f-4b0a-b43d-58624ba737b7 req-4fe539e5-5c97-4051-bca4-3e2d082e9cfc tempest-MigrationsAdminTest-1384528618 tempest-MigrationsAdminTest-1384528618-project-member] Enqueued Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 887.791729] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 887.791962] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.792100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.792196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.792406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.792557] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.794523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.794523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.794523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.794523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.794523] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.837054] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: SUCCESS [ 887.837636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.837770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.837988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.838200] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.838324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.838388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.838558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.838631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.838714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.838813] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.840481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.840481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.843583] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.843583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.843583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.843583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.843583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.843583] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.030508] env[62620]: INFO networking_nsxv3.common.synchronization [req-1eb60e4c-b8cc-4684-ab98-b93d27b9eb65 req-d870940b-0021-4f6e-aff8-8cb8a46403e0 service nova] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_rules [ 888.031215] env[62620]: INFO networking_nsxv3.common.synchronization [req-1eb60e4c-b8cc-4684-ab98-b93d27b9eb65 req-d870940b-0021-4f6e-aff8-8cb8a46403e0 service nova] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 888.036202] env[62620]: INFO networking_nsxv3.common.synchronization [req-1eb60e4c-b8cc-4684-ab98-b93d27b9eb65 req-d870940b-0021-4f6e-aff8-8cb8a46403e0 service nova] Enqueued Resource ID: 93a8b363-e41a-4ac2-abf1-274395673a5b with Priority: HIGHEST for action port [ 888.039545] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_rules [ 888.039545] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 888.039545] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93a8b363-e41a-4ac2-abf1-274395673a5b with Priority: HIGHEST for action port [ 888.039545] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.039545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.039545] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.039545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.039545] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-93a8b363-e41a-4ac2-abf1-274395673a5b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.039545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93a8b363-e41a-4ac2-abf1-274395673a5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.039545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93a8b363-e41a-4ac2-abf1-274395673a5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.039545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93a8b363-e41a-4ac2-abf1-274395673a5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.039545] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93a8b363-e41a-4ac2-abf1-274395673a5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.048286] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 888.048468] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 deletion is rescheduled due to dependency. [ 888.048578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.049945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.049945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.050747] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.051105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.051105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.051188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.051219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.051339] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.295901] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.347018] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.347018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.347018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.347018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.347018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.365994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.366222] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.366343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.366411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.366618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.366704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.366792] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be updated. [ 888.395368] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.395557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.395635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.395848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.396007] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.407026] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: IN_PROGRESS for 2s [ 888.455800] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-2b720536-4b3f-4165-b5fd-560d982368cf service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 888.455984] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-2b720536-4b3f-4165-b5fd-560d982368cf service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 888.456193] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-2b720536-4b3f-4165-b5fd-560d982368cf service nova] Enqueued Resource ID: e9aeb5b9-eeec-406e-a7d0-6207531ec459 with Priority: HIGHEST for action port [ 888.456376] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 888.456501] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 888.456592] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9aeb5b9-eeec-406e-a7d0-6207531ec459 with Priority: HIGHEST for action port [ 888.458858] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.458969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.459202] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.459281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.459453] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9aeb5b9-eeec-406e-a7d0-6207531ec459 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.459547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9aeb5b9-eeec-406e-a7d0-6207531ec459" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.459609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9aeb5b9-eeec-406e-a7d0-6207531ec459" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.459811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9aeb5b9-eeec-406e-a7d0-6207531ec459" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.459888] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9aeb5b9-eeec-406e-a7d0-6207531ec459',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.513692] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 in Status: SUCCESS [ 888.513692] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 deletion is rescheduled due to dependency. [ 888.513692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.542103] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93a8b363-e41a-4ac2-abf1-274395673a5b with status ACTIVE [ 888.542103] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.542103] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.542103] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.542103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.542646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.542646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.542646] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93a8b363-e41a-4ac2-abf1-274395673a5b is going to be updated. [ 888.555798] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.559929] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.560146] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.560277] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.560746] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.560886] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.561106] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.561275] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.561511] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.561660] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.561875] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.561998] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.562118] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.562228] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.562343] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.562451] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.562590] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.566534] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.566680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.566680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.566802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.567386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.567386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93a8b363-e41a-4ac2-abf1-274395673a5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.579110] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.579351] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 888.579527] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.579757] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.580211] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.580410] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.580546] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.580902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.581631] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a5f7c0b-f029-481c-a96f-0d9789d6bad5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.798902] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.850177] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5055d880-77be-4c89-8a2a-a2e60908e12a: rpc.has_security_group_logging(os_id): False [ 888.867562] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.870043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.870043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.870043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.870043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.870043] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.870043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.870043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.870043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.870043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.870043] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be updated. [ 888.927698] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.927698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.927698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.927979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.927979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.957581] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: IN_PROGRESS for 2s [ 888.962018] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9aeb5b9-eeec-406e-a7d0-6207531ec459 with status ACTIVE [ 888.962264] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.962401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.962803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.962803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.962803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.962987] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.963229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.963229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.963561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.963561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.963561] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.963668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.964483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.964483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.964483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.964483] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9aeb5b9-eeec-406e-a7d0-6207531ec459 is going to be updated. [ 889.059418] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.076774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.078021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.078021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.078021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.078021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.078021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9aeb5b9-eeec-406e-a7d0-6207531ec459" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.083746] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.084248] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.084407] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.084675] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.084891] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.084986] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 4a5f7c0b-f029-481c-a96f-0d9789d6bad5 not found, creating... [ 889.085273] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.085442] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.085562] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.085782] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.085914] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.086233] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.087941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.088152] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.088395] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.088632] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.088696] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 4a5f7c0b-f029-481c-a96f-0d9789d6bad5 is going to be created. [ 889.131134] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.131134] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.131134] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.131134] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.131134] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.133389] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.203616] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 889.203888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.204098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.204376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.204519] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.204638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.204706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.204849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.204929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.205023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.205786] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.206225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.206948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.206948] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.206948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.206948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.206948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.206948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.206948] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.302050] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.302155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.303301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.303301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.303301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.303301] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b is going to be updated. [ 889.332290] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.332451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.332527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.332733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.332881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.342076] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: IN_PROGRESS for 2s [ 889.561988] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.562174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.562241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.562461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.562552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.562648] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 889.589971] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.590117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.590186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.590445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.590618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.599142] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 889.708409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.708626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.708745] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.079808] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.080273] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-167" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.080273] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-167" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.080627] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-167" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.080821] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.082413] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.082507] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.082757] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.082959] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.083247] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.083394] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.083515] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.083665] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.083829] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.083881] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.084053] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.101784] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.102175] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.105209] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.105484] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-167" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.105834] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-e8a543dc-e58e-4c74-a763-b795643a2d53 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.106020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-e8a543dc-e58e-4c74-a763-b795643a2d53" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.106147] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-e8a543dc-e58e-4c74-a763-b795643a2d53" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.106506] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-e8a543dc-e58e-4c74-a763-b795643a2d53" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.107033] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8a543dc-e58e-4c74-a763-b795643a2d53',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.218438] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.416630] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: SUCCESS [ 890.417121] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a deletion is rescheduled due to dependency. [ 890.417812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.511794] env[62620]: INFO networking_nsxv3.common.synchronization [req-bf808392-fe5f-4b0a-b43d-58624ba737b7 req-cf779aa2-a5fb-4b79-8963-6ed7f4e957c3 service nova] Enqueued Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_rules [ 890.511794] env[62620]: INFO networking_nsxv3.common.synchronization [req-bf808392-fe5f-4b0a-b43d-58624ba737b7 req-cf779aa2-a5fb-4b79-8963-6ed7f4e957c3 service nova] Enqueued Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 890.511794] env[62620]: INFO networking_nsxv3.common.synchronization [req-bf808392-fe5f-4b0a-b43d-58624ba737b7 req-cf779aa2-a5fb-4b79-8963-6ed7f4e957c3 service nova] Enqueued Resource ID: 4a5f7c0b-f029-481c-a96f-0d9789d6bad5 with Priority: HIGHEST for action port [ 890.511969] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_rules [ 890.512103] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 890.512220] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5f7c0b-f029-481c-a96f-0d9789d6bad5 with Priority: HIGHEST for action port [ 890.512787] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.512914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.512976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.513873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.513964] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.518826] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.518826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.518826] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.518826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.518826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.518826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.518826] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a5f7c0b-f029-481c-a96f-0d9789d6bad5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.593097] env[62620]: INFO networking_nsxv3.common.synchronization [req-b51765bb-0272-4324-9976-aeb779899da9 req-3e3a3e1c-8266-4086-9975-983862712076 tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 890.593097] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 890.593097] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.593097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.593097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.594115] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.594480] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.595537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.595537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.595861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.596085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.597763] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.613241] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.613241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.613241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.613241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.613241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.613241] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port e8a543dc-e58e-4c74-a763-b795643a2d53 not found, creating... [ 890.613241] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.613241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.613241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.613241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.613241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.613692] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.613692] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.613692] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.614355] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.614666] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.617237] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: e8a543dc-e58e-4c74-a763-b795643a2d53 is going to be created. [ 890.634315] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.635460] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.635675] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.635959] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.636416] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.636789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-e8a543dc-e58e-4c74-a763-b795643a2d53" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.721033] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.721992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.722275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.722446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.722603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.722719] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 890.755812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.755994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.756095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.756323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.756554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.766674] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 890.972821] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5055d880-77be-4c89-8a2a-a2e60908e12a in Status: SUCCESS [ 890.973084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.019072] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.019250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.019390] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a5f7c0b-f029-481c-a96f-0d9789d6bad5 with status ACTIVE [ 891.019556] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.019658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.019728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.019942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.020039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.020211] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.020291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.020379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.020552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.020627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.020814] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.020921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.020982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.021124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.021194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.021277] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a5f7c0b-f029-481c-a96f-0d9789d6bad5 is going to be updated. [ 891.052384] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.052753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.052753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.052978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.053118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.053985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a5f7c0b-f029-481c-a96f-0d9789d6bad5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.099028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.099380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.099380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.099465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.119699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.120340] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.120340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.120340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.120539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.120539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.120539] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 891.161226] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.161226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.161388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.161499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.161645] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.177915] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 891.351526] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: SUCCESS [ 891.351779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.351949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.352210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.352394] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.352506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.352569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.352722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.352975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.352975] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.618294] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 891.618428] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.618621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.618843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.619046] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.619173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.619242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.619396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.619469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.619556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.619647] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.627272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.627551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.627712] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.627827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.627893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.628055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.628141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.628237] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.629717] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.629900] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.632108] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.632677] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.633052] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.633305] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.633505] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.633770] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.633975] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.634274] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.634401] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.634531] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.634649] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.634777] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.634890] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.635057] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.657223] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.657605] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.657968] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.658517] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.659070] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.659351] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.659547] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.660083] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.660298] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('993b71f3-f13a-4db1-b2b7-2da39bd4d41e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.857950] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.139523] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.140736] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.140892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.163262] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.163498] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.163714] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.163927] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.164099] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.164312] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 993b71f3-f13a-4db1-b2b7-2da39bd4d41e not found, creating... [ 892.164595] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.164765] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.164886] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.165139] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.165296] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.165620] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.165733] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.165854] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.167978] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.167978] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.167978] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 993b71f3-f13a-4db1-b2b7-2da39bd4d41e is going to be created. [ 892.192030] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.192300] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.192434] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.192711] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.192946] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.193202] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.242430] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-b534e2a2-34cd-40ef-9252-01a1fc60faab service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 892.242616] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-b534e2a2-34cd-40ef-9252-01a1fc60faab service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 892.242758] env[62620]: INFO networking_nsxv3.common.synchronization [req-cd842f98-9835-46e0-92ed-af56d2ea1450 req-b534e2a2-34cd-40ef-9252-01a1fc60faab service nova] Enqueued Resource ID: e8a543dc-e58e-4c74-a763-b795643a2d53 with Priority: HIGHEST for action port [ 892.243314] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 892.243611] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 892.243611] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8a543dc-e58e-4c74-a763-b795643a2d53 with Priority: HIGHEST for action port [ 892.244088] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.244088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.244088] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.244363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.244490] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8a543dc-e58e-4c74-a763-b795643a2d53 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.244627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8a543dc-e58e-4c74-a763-b795643a2d53" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.244627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8a543dc-e58e-4c74-a763-b795643a2d53" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.246530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8a543dc-e58e-4c74-a763-b795643a2d53" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.246530] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8a543dc-e58e-4c74-a763-b795643a2d53',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.361338] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.642130] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.746576] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8a543dc-e58e-4c74-a763-b795643a2d53 with status ACTIVE [ 892.746968] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.747339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.747559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.747889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.748589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.748589] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.748589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.748589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.748865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.748865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.749078] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.749275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.749377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.749612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.749789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.749789] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8a543dc-e58e-4c74-a763-b795643a2d53 is going to be updated. [ 892.771160] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.771320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.771392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.771605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.771734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.771934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8a543dc-e58e-4c74-a763-b795643a2d53" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.777208] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 892.777589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.777827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.778110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.778339] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.778455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.778537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.778693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.778789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.778877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.779057] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.779144] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.779208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.779355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.779492] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.779590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.779652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.779789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.779879] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.780242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.780402] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.781382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.784310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.784310] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.784310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.784310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.784310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.784310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.784310] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.862959] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.863192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.863253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.863450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.863607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.863771] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b is going to be updated. [ 892.899497] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.899769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.899876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.900152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.902914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.916168] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: IN_PROGRESS for 2s [ 893.062245] env[62620]: INFO networking_nsxv3.common.synchronization [req-fccbd0e8-51b9-4701-82ce-b34b917d1e79 req-dd5dea13-3f28-4dcf-ae82-b5adc8eecc69 tempest-ServersAdminTestJSON-158660873 tempest-ServersAdminTestJSON-158660873-project-member] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 893.062245] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 893.062245] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.062245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.062245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.062245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.062803] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.063047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.063190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.063419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.063580] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.063756] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.145466] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.148569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.148569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.148569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.148569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.148569] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 893.188766] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.188876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.188972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.190743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.190886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.192709] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 893.192804] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 deletion is rescheduled due to dependency. [ 893.192898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.207748] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 893.284670] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 787f7736-c1a9-4a6d-8e59-532c4a82467e: rpc.has_security_group_logging(os_id): False [ 893.286989] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.304146] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.304864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.304864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.304864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.304864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.305126] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.305126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.305218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.305358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.305432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.306157] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.306157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.306157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.306157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.306536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.307904] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.307904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.307904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.307904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.307904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.307904] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be created. [ 893.361359] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.362212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.362212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.362212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.362212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.374335] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 893.497361] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-427 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.500292] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.500292] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.500292] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.500292] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.500292] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.500292] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.503067] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.503067] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.503067] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.503067] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.503067] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.503067] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.503067] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.503067] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.503067] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.524766] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.525138] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 893.525413] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.525716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-427" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.529564] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-dca7e38e-83c7-4679-824f-f98d9fc325ad taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.529880] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-dca7e38e-83c7-4679-824f-f98d9fc325ad" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.530129] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-dca7e38e-83c7-4679-824f-f98d9fc325ad" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.530623] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-dca7e38e-83c7-4679-824f-f98d9fc325ad" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.530881] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca7e38e-83c7-4679-824f-f98d9fc325ad',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.565978] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.789441] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.946347] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 893.946347] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent loop - iteration:1 started [ 894.033914] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.034455] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.034679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.035016] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.035781] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.036010] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port dca7e38e-83c7-4679-824f-f98d9fc325ad not found, creating... [ 894.036429] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.036901] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.037090] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.037393] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.037874] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.038491] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.038713] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.039038] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.039317] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.039466] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.039617] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: dca7e38e-83c7-4679-824f-f98d9fc325ad is going to be created. [ 894.050351] env[62620]: INFO networking_nsxv3.common.synchronization [req-b51765bb-0272-4324-9976-aeb779899da9 req-0ae37d1e-4700-4cbf-9049-84f7e165f7ba service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 894.050547] env[62620]: INFO networking_nsxv3.common.synchronization [req-b51765bb-0272-4324-9976-aeb779899da9 req-0ae37d1e-4700-4cbf-9049-84f7e165f7ba service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 894.051505] env[62620]: INFO networking_nsxv3.common.synchronization [req-b51765bb-0272-4324-9976-aeb779899da9 req-0ae37d1e-4700-4cbf-9049-84f7e165f7ba service nova] Enqueued Resource ID: 993b71f3-f13a-4db1-b2b7-2da39bd4d41e with Priority: HIGHEST for action port [ 894.051691] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 894.051826] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 894.051932] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993b71f3-f13a-4db1-b2b7-2da39bd4d41e with Priority: HIGHEST for action port [ 894.053243] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.053243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.053243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.053243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.053243] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.057535] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.057535] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.057535] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.057535] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.057535] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('993b71f3-f13a-4db1-b2b7-2da39bd4d41e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.061306] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.061498] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.061672] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.061874] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.062221] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.062454] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-dca7e38e-83c7-4679-824f-f98d9fc325ad" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.069417] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.297092] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.297399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.297399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.297538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.297758] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.297758] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 894.326202] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.326351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.326646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.326646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.326825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.337987] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 894.560655] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.560796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.564636] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 993b71f3-f13a-4db1-b2b7-2da39bd4d41e with status ACTIVE [ 894.565422] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.565422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.565422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.565422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.565422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.565584] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.566011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.566011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.566011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.566011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.566258] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.566258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.566379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.566468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.566543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.566640] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 993b71f3-f13a-4db1-b2b7-2da39bd4d41e is going to be updated. [ 894.572800] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.573888] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.574021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.574083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.574269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.577551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.577551] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 894.599162] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.599162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.599468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.599468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.599570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.599662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-993b71f3-f13a-4db1-b2b7-2da39bd4d41e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.609740] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.609905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.610061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.610188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.610352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.618789] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 894.926436] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: SUCCESS [ 894.926740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.926843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.927040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.927262] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.927421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.927512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.927671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.927802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.927913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.928024] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.076767] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.218272] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 895.218272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.218272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.218272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.218492] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.218599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.218840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.218840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.218937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.219037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.219240] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.219345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.219486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.219583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.219753] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.219856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.219929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.220115] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.220198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.220308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.220404] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.390055] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 895.390900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.390900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.390900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.390900] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.430384] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.430461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.430520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.430763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.430918] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.431026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.431090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.431245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.431329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.431416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.431559] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.431653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.431715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.431864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.431998] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.432098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.432159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.432561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.432561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.432561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.432561] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.580233] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.580397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.580511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.580751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.580862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.581024] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 895.606446] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.606446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.606608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.606774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.606972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.616384] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 895.723406] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32910d79-8601-44ca-ba8c-4e47ddc77063: rpc.has_security_group_logging(os_id): False [ 895.741735] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.743159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.743377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.743773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.743972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.744416] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.744737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.745132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.745533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.746237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.746570] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.749389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.749389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.749389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.749389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.749389] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.749389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.749389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.749389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.749389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.749389] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 895.815553] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.815734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.815823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.816132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.816229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.831544] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 895.844843] env[62620]: INFO networking_nsxv3.common.synchronization [req-fccbd0e8-51b9-4701-82ce-b34b917d1e79 req-3ec7ca4c-e863-4781-983f-69041eef5fce service nova] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_rules [ 895.845018] env[62620]: INFO networking_nsxv3.common.synchronization [req-fccbd0e8-51b9-4701-82ce-b34b917d1e79 req-3ec7ca4c-e863-4781-983f-69041eef5fce service nova] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 895.845502] env[62620]: INFO networking_nsxv3.common.synchronization [req-fccbd0e8-51b9-4701-82ce-b34b917d1e79 req-3ec7ca4c-e863-4781-983f-69041eef5fce service nova] Enqueued Resource ID: dca7e38e-83c7-4679-824f-f98d9fc325ad with Priority: HIGHEST for action port [ 895.845502] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_rules [ 895.845502] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 895.845605] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dca7e38e-83c7-4679-824f-f98d9fc325ad with Priority: HIGHEST for action port [ 895.846209] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.846359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.846961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.846961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.846961] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.848059] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.848186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.848852] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-dca7e38e-83c7-4679-824f-f98d9fc325ad taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.848852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dca7e38e-83c7-4679-824f-f98d9fc325ad" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.848852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dca7e38e-83c7-4679-824f-f98d9fc325ad" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.848852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dca7e38e-83c7-4679-824f-f98d9fc325ad" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.848852] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca7e38e-83c7-4679-824f-f98d9fc325ad',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.893202] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.893202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.936567] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16d45250-e90b-4ed6-befa-bdaacfced30b: rpc.has_security_group_logging(os_id): False [ 895.966153] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.966153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.966153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.966153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.985640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.989862] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.989954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.990110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.990395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.990395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.990631] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.990782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.990782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.990950] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.991085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.991219] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.992105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.992105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.992105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.992105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.992105] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b is going to be updated. [ 896.060284] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.061489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.061578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.061809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.062648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.076398] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: IN_PROGRESS for 2s [ 896.347804] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 896.348217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.348497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.348791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.349082] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.350813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.350813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.350813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.350813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.350813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.350813] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.351652] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.351826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.352067] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dca7e38e-83c7-4679-824f-f98d9fc325ad with status ACTIVE [ 896.352356] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.352625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.352736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.352948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.353671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.353671] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.353671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.353671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.353671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.354747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.354747] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.354747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.354747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.354747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.355883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.355883] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dca7e38e-83c7-4679-824f-f98d9fc325ad is going to be updated. [ 896.375588] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.376211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.376479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.376783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.377321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.378413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dca7e38e-83c7-4679-824f-f98d9fc325ad" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.496878] env[62620]: INFO networking_nsxv3.common.synchronization [req-c0a5fdc9-c024-4ab2-8f1b-684df03dd9c0 req-84b7529c-ef99-4d8f-914d-d6c114e51b4f tempest-ServerAddressesNegativeTestJSON-609171485 tempest-ServerAddressesNegativeTestJSON-609171485-project-member] Enqueued Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGHEST for action security_group_members [ 896.500790] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGHEST for action security_group_members [ 896.500790] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27b32b5-c396-4e4a-8708-8560672f7010 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.500790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.500790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.500790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.500790] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.500790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.500790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.500790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.500790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.500790] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27b32b5-c396-4e4a-8708-8560672f7010',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.634743] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 896.634743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.634743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.634743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.634743] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.634743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.634743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.634743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.634743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.634743] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.857289] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.860019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.860019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.860019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.860019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.860937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.860937] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.003409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.003409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.003409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.003409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.003409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.003409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.003409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.003409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.003409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.003409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.003409] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27b32b5-c396-4e4a-8708-8560672f7010 already deleted. [ 897.003409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.080889] env[62620]: INFO networking_nsxv3.common.synchronization [None req-44c78857-3d3c-4f24-8026-a0b6205e0ba0 None None] Enqueued Resource ID: 08f75aba-e713-45f0-85e9-d570c967ee07 with Priority: HIGHEST for action port [ 897.080889] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f75aba-e713-45f0-85e9-d570c967ee07 with Priority: HIGHEST for action port [ 897.080889] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-08f75aba-e713-45f0-85e9-d570c967ee07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.080889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08f75aba-e713-45f0-85e9-d570c967ee07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.080889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08f75aba-e713-45f0-85e9-d570c967ee07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.080889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08f75aba-e713-45f0-85e9-d570c967ee07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.080889] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08f75aba-e713-45f0-85e9-d570c967ee07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.142931] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.368405] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 787f7736-c1a9-4a6d-8e59-532c4a82467e: rpc.has_security_group_logging(os_id): False [ 897.386402] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.386861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.386950] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.387231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.387813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.387813] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.387813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.387813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.388067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.388102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.388318] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.388432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.388515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.388647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.388722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.389375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.389538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.389635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.389820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.389954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.390090] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 897.460573] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.462428] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-772" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.462618] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-772" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.462966] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-772" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.464912] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.465133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.465264] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.466595] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.466791] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.467029] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.467156] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.467273] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.467390] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.467498] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.467607] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.467747] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.471786] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.471947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.471980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.472151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.472295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.511645] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 897.516930] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.518906] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 897.518906] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.518906] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-772" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.518906] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.518906] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.518906] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.518906] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.519382] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c970a80-e9f6-4f52-944e-27b8cc62ad4b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.583946] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08f75aba-e713-45f0-85e9-d570c967ee07 [ 897.583946] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.583946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.583946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.584192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.584295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.584406] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08f75aba-e713-45f0-85e9-d570c967ee07 already deleted. [ 897.584514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08f75aba-e713-45f0-85e9-d570c967ee07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.627520] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 897.630040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.630040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.630266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.630439] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.630564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.630641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.630811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.630907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.630997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.632071] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.645059] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.850502] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 897.850502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.850502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.850502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.850502] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.021437] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.021749] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.021951] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.023211] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.023445] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.024082] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 7c970a80-e9f6-4f52-944e-27b8cc62ad4b not found, creating... [ 898.024493] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.024689] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.024811] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.025152] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.025349] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.025704] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.025865] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.025996] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.027729] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.027840] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.027912] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 7c970a80-e9f6-4f52-944e-27b8cc62ad4b is going to be created. [ 898.048899] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.049145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.049283] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.049566] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.049800] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.050044] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.092908] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: SUCCESS [ 898.093221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.134965] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.135305] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.135679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.135962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.136211] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.136356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.136437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.136641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.136748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.136828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.136994] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.137139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.137204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.137375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.137537] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.138368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.138465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.140579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.140579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.140579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.140579] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.146947] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.147222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.147358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.147629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.147768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.147937] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 898.196648] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.196854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.196937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.197136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.197285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.212148] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 898.244550] env[62620]: INFO networking_nsxv3.common.synchronization [None req-03d2623e-905a-4ad2-89f0-57123527b3c5 None None] Enqueued Resource ID: 4037673c-e30e-4b25-b0cb-b7784c390243 with Priority: HIGHEST for action port [ 898.244766] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4037673c-e30e-4b25-b0cb-b7784c390243 with Priority: HIGHEST for action port [ 898.245478] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4037673c-e30e-4b25-b0cb-b7784c390243 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.245806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4037673c-e30e-4b25-b0cb-b7784c390243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.246028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4037673c-e30e-4b25-b0cb-b7784c390243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.246441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4037673c-e30e-4b25-b0cb-b7784c390243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.246726] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4037673c-e30e-4b25-b0cb-b7784c390243',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.354409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.354409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.354409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.354409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.354409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.354409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.354409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.354409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.354409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.354409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.354409] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.642568] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c995751-5151-4812-a1e5-510ea09222e0: rpc.has_security_group_logging(os_id): False [ 898.661027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.661027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.661027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.661027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.662368] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.662368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.662498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.662972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.662972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.662972] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 898.730072] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.730246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.730291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.732051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.732051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.745455] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 898.752276] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4037673c-e30e-4b25-b0cb-b7784c390243 [ 898.752759] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.753214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.753214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.753214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.753356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.753417] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4037673c-e30e-4b25-b0cb-b7784c390243 already deleted. [ 898.753499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4037673c-e30e-4b25-b0cb-b7784c390243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.857060] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.857744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.857861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.858214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.858630] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.859069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.859069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.859327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.859682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.860265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.860397] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.860550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.860682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.861094] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.861174] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.861358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.861358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.861613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.863039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.863039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.863039] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.185336] env[62620]: INFO networking_nsxv3.common.synchronization [req-c0a5fdc9-c024-4ab2-8f1b-684df03dd9c0 req-3289a0e9-7b02-491a-9800-3aa2e3a168b3 service nova] Enqueued Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGHEST for action security_group_rules [ 899.185462] env[62620]: INFO networking_nsxv3.common.synchronization [req-c0a5fdc9-c024-4ab2-8f1b-684df03dd9c0 req-3289a0e9-7b02-491a-9800-3aa2e3a168b3 service nova] Enqueued Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGHEST for action security_group_members [ 899.185621] env[62620]: INFO networking_nsxv3.common.synchronization [req-c0a5fdc9-c024-4ab2-8f1b-684df03dd9c0 req-3289a0e9-7b02-491a-9800-3aa2e3a168b3 service nova] Enqueued Resource ID: 7c970a80-e9f6-4f52-944e-27b8cc62ad4b with Priority: HIGHEST for action port [ 899.185874] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGHEST for action security_group_rules [ 899.186014] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGHEST for action security_group_members [ 899.186116] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c970a80-e9f6-4f52-944e-27b8cc62ad4b with Priority: HIGHEST for action port [ 899.187204] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27b32b5-c396-4e4a-8708-8560672f7010 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.187336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.187425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.187799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.187799] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27b32b5-c396-4e4a-8708-8560672f7010',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.188754] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27b32b5-c396-4e4a-8708-8560672f7010 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.188871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.188939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.189156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.189312] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.189411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.189464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.189610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.189712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.189804] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27b32b5-c396-4e4a-8708-8560672f7010',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.191322] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.191433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.191502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.192394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.192490] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c970a80-e9f6-4f52-944e-27b8cc62ad4b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.368584] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32910d79-8601-44ca-ba8c-4e47ddc77063: rpc.has_security_group_logging(os_id): False [ 899.387740] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.387907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.387988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.388308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.388308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.388551] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.388655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.388721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.388883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.389138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.389209] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.389263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.389295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.389442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.389632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.389696] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.389801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.389864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.390016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.390095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.390183] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 899.454531] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.454531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.454531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.454531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.454531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.470813] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 899.527466] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 899.527466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.527466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.527466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.527466] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.614551] env[62620]: INFO networking_nsxv3.common.synchronization [None req-7d64d62c-192b-44ff-95bc-0f359356d6b6 tempest-ServersV294TestFqdnHostnames-171705297 tempest-ServersV294TestFqdnHostnames-171705297-project-member] Enqueued Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_rules [ 899.614551] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_rules [ 899.617967] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.617967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.617967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.617967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.618145] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.693009] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c27b32b5-c396-4e4a-8708-8560672f7010',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.695962] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27b32b5-c396-4e4a-8708-8560672f7010 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.695962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.695962] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c970a80-e9f6-4f52-944e-27b8cc62ad4b with status ACTIVE [ 899.695962] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.695962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.695962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.697731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.697731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.698158] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.698356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.698467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.699549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.699674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.700695] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.700695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.700695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.700695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.700695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.700695] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c970a80-e9f6-4f52-944e-27b8cc62ad4b is going to be updated. [ 899.723188] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.723188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.723188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.723349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.723465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.723606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c970a80-e9f6-4f52-944e-27b8cc62ad4b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.726975] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d1ef899e-792f-48ae-a5c0-4e895d8edd45 tempest-ServersV294TestFqdnHostnames-171705297 tempest-ServersV294TestFqdnHostnames-171705297-project-member] Enqueued Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_rules [ 899.727692] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_rules [ 899.727959] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.728099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.035142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.035142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.035142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.035142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.035142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.035142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.035142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.035142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.035142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.035142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.035142] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.142493] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.142493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.142493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.142493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.142493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.142493] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a already deleted. [ 900.142493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.142493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.142493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.142493] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.166128] env[62620]: INFO networking_nsxv3.common.synchronization [None req-698e6038-0c7f-4efe-92ff-589e4d542058 None None] Enqueued Resource ID: f27341fc-a056-4977-a19e-bd2fb4ff0aac with Priority: HIGHEST for action port [ 900.166715] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f27341fc-a056-4977-a19e-bd2fb4ff0aac with Priority: HIGHEST for action port [ 900.167691] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-f27341fc-a056-4977-a19e-bd2fb4ff0aac taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.167815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f27341fc-a056-4977-a19e-bd2fb4ff0aac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.168101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f27341fc-a056-4977-a19e-bd2fb4ff0aac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.168754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f27341fc-a056-4977-a19e-bd2fb4ff0aac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.168850] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f27341fc-a056-4977-a19e-bd2fb4ff0aac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.198512] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c27b32b5-c396-4e4a-8708-8560672f7010',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.223589] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 900.223830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.224375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.225794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.225794] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.225794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.225794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.225794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.225794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.225794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.225794] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.239711] env[62620]: INFO networking_nsxv3.common.synchronization [None req-9349f263-0a5a-4bb4-9183-4850a56366ab None None] Enqueued Resource ID: 4744d995-408f-4b89-ba6b-5db5d112bb7b with Priority: HIGHEST for action port [ 900.239711] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4744d995-408f-4b89-ba6b-5db5d112bb7b with Priority: HIGHEST for action port [ 900.239711] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4744d995-408f-4b89-ba6b-5db5d112bb7b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.239711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4744d995-408f-4b89-ba6b-5db5d112bb7b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.239711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4744d995-408f-4b89-ba6b-5db5d112bb7b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.239711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4744d995-408f-4b89-ba6b-5db5d112bb7b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.239711] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4744d995-408f-4b89-ba6b-5db5d112bb7b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.345058] env[62620]: INFO networking_nsxv3.common.synchronization [None req-0d332430-1cff-4a62-aead-51b7e4fd0c46 tempest-ServerActionsTestOtherB-764568701 tempest-ServerActionsTestOtherB-764568701-project-member] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 900.345675] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 900.346029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.347422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.347422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.347602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.347602] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.353159] env[62620]: INFO networking_nsxv3.common.synchronization [req-fbd4e3fb-0e1c-412d-9116-6459271003c6 req-f5262100-b1df-43a6-88c8-de997d28ba51 tempest-ImagesOneServerNegativeTestJSON-1314187372 tempest-ImagesOneServerNegativeTestJSON-1314187372-project-member] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 900.353890] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 900.354247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.354432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.354474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.354692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.354856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.354969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.355049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.355206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.355293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.355402] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.539373] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.539541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.539617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.539841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.540082] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.540152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.540184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.540358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.540412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.540494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.540644] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.540767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.540838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.541174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.541174] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.541174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.541466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.541466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.541585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.541648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.542443] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.663281] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.663281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.663281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.663281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.663281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.663281] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a already deleted. [ 900.663281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.671636] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f27341fc-a056-4977-a19e-bd2fb4ff0aac [ 900.671636] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.671636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.671636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.671636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.671636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.672113] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f27341fc-a056-4977-a19e-bd2fb4ff0aac already deleted. [ 900.672151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f27341fc-a056-4977-a19e-bd2fb4ff0aac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.701648] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.701648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.701648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.702037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.702037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.702037] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27b32b5-c396-4e4a-8708-8560672f7010 is going to be created. [ 900.718783] env[62620]: INFO networking_nsxv3.common.synchronization [None req-e96b89e9-98ac-42ea-9f79-d9e0471142be tempest-ServerActionsTestOtherB-764568701 tempest-ServerActionsTestOtherB-764568701-project-member] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 900.719325] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 900.719949] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.719949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.727198] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.727198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.727198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.727198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.727198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.728442] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.728606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.728681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.728871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.729046] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.729550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.729637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.729853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.729963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.730278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.730467] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.730791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.730791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.730896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.731020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.731656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.731656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.731656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.731656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.731656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.731656] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.741492] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27b32b5-c396-4e4a-8708-8560672f7010 in Status: UNINITIALIZED for 2s [ 900.744054] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4744d995-408f-4b89-ba6b-5db5d112bb7b [ 900.744054] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.744054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.744054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.744054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.744054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.744054] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4744d995-408f-4b89-ba6b-5db5d112bb7b already deleted. [ 900.744054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4744d995-408f-4b89-ba6b-5db5d112bb7b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.758758] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 900.759061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.859392] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.859576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.859634] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.859899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.873724] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.873928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.887396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.887691] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.887844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.887906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.888188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.888188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.888295] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be updated. [ 900.889397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.889625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.890020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.890020] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 already deleted. [ 900.890020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.891597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.891927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.892073] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.935718] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.935874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.938257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.938257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.938257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.948195] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: IN_PROGRESS for 2s [ 901.044211] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 787f7736-c1a9-4a6d-8e59-532c4a82467e: rpc.has_security_group_logging(os_id): False [ 901.061045] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.061296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.061390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.061771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.062221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.062575] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.063892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.063983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.064214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.064385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.064714] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.064859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.064930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.065132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.065218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.065441] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.065591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.065670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.065847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.065928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.066026] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 901.131333] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.131493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.131570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.132276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.132276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.149862] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 901.236484] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b140e556-13f7-4e22-a7d6-53ddc3943100: rpc.has_security_group_logging(os_id): False [ 901.259872] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.260415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.260415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.260415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.280119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.280452] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.280583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.280668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.280879] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.280966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.281209] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.281314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.281404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.281562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.281640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.281856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.281955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.282050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.282221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.282322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.282418] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 901.350061] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.350061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.350061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.350290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.350321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.365542] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 901.414320] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.414320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.414320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.414542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.414542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.414618] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 already deleted. [ 901.414674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.495197] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 901.495197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.360150] env[62620]: INFO networking_nsxv3.common.synchronization [req-906c8ed3-1050-42a5-8029-69cfd3c9d205 req-7c2b5683-f649-4f75-89c5-59ac6b80d121 tempest-MultipleCreateTestJSON-1897705394 tempest-MultipleCreateTestJSON-1897705394-project-member] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 902.361521] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 902.361521] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.361521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.362762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.363031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.363528] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.363528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.363528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.363751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.363751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.363751] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.753116] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27b32b5-c396-4e4a-8708-8560672f7010 in Status: SUCCESS [ 902.753116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.753116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.753116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.753116] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.753116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.753116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.753116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.753116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.753116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.753116] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c27b32b5-c396-4e4a-8708-8560672f7010',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.867161] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.958418] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 902.958598] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 deletion is rescheduled due to dependency. [ 902.958708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.026754] env[62620]: INFO networking_nsxv3.common.synchronization [req-dd49e997-61fd-48e6-afd0-481021c08df8 req-74edfe7d-eb53-4739-ae23-10920c9997de tempest-MultipleCreateTestJSON-1897705394 tempest-MultipleCreateTestJSON-1897705394-project-member] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 903.027309] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGHEST for action security_group_members [ 903.027622] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.027728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.163711] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 903.163711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.258783] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27b32b5-c396-4e4a-8708-8560672f7010 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.259108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.259278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.259561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.259733] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.259842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.259915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.260114] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.260208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.260328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.260556] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27b32b5-c396-4e4a-8708-8560672f7010 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.260618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.260694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.260851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.261014] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.261121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.261182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.261636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.261636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.261636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.261636] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c27b32b5-c396-4e4a-8708-8560672f7010',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.372036] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.380458] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 903.380625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.771248] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c27b32b5-c396-4e4a-8708-8560672f7010: rpc.has_security_group_logging(os_id): False [ 903.788199] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.788385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.788504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.788672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.788766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.788961] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.789081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.789133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.789316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.789370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.789545] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.789780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.789780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.789896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.789896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.790074] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.790201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.790243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.791314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.792201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.792320] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27b32b5-c396-4e4a-8708-8560672f7010 is going to be created. [ 903.847152] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.847315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.847372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.847690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.847908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.863527] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27b32b5-c396-4e4a-8708-8560672f7010 in Status: IN_PROGRESS for 2s [ 903.875640] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.875903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.879127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.879127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.879127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.879413] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 903.956132] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.956457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.956457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.956600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.956755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.009194] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 905.876215] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27b32b5-c396-4e4a-8708-8560672f7010 in Status: SUCCESS [ 905.876215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.018560] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 906.018782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.018954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.019184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.019370] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.019495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.019558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.019708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.019787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.019872] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.350122] env[62620]: INFO networking_nsxv3.common.synchronization [req-5d6a9703-b342-42a4-869a-af23a1d5a221 req-358ded92-7a29-432d-acc2-4b7e79d02a4e tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 906.350122] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 906.350122] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.350122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.350122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.350806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.351139] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.351411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.352069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.352069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.352069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.352069] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.522635] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.522830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.522898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.523147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.523243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.523450] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.523554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.523632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.523784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.523857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.523943] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be updated. [ 906.560954] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.561156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.561242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.561459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.561604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.572129] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: IN_PROGRESS for 2s [ 906.856351] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.856734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.856939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.858848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.879298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.879298] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.879298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.879298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.879298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.879298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.879298] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 906.914581] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.914581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.914581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.914581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.914581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.923434] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 907.027319] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.027563] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.027717] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.028015] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.028942] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.029145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.029279] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.029601] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.029758] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.029984] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.030120] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.030241] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.030815] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.030815] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.030815] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.030966] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.052337] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.052337] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 907.052337] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.052337] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.052337] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.052653] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.052698] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.053969] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.054367] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8163fefd-89a3-4ff5-bbc9-e1561f91bc68',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.557402] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.557868] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.557868] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.558189] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.558346] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.558516] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 8163fefd-89a3-4ff5-bbc9-e1561f91bc68 not found, creating... [ 907.558788] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.558959] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.559094] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.559330] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.559476] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.560279] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.560279] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.560279] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.560279] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.560556] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.560556] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 8163fefd-89a3-4ff5-bbc9-e1561f91bc68 is going to be created. [ 907.578940] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.579209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.579357] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.579661] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.579929] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.580264] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.654717] env[62620]: INFO networking_nsxv3.common.synchronization [req-a714923c-39ce-44fd-beff-e8a2003abba2 req-8c071b99-926a-4c32-903b-dada42912b34 tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 907.655318] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 907.655686] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.655818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.655880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.656111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.656269] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.656373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.656438] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.656589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.656677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.656781] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.159310] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.196335] env[62620]: INFO networking_nsxv3.common.synchronization [req-a714923c-39ce-44fd-beff-e8a2003abba2 req-d1cb9d3d-b14d-4a1d-a417-3418bb0405aa tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 908.196492] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 908.197125] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.197286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.563843] env[62620]: INFO networking_nsxv3.common.synchronization [req-a714923c-39ce-44fd-beff-e8a2003abba2 req-abbbba75-2bae-4a08-881c-2e8436dde68d tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 908.563843] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 908.563843] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.563843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.582966] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 in Status: SUCCESS [ 908.583206] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 deletion is rescheduled due to dependency. [ 908.583583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.664532] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.715854] env[62620]: INFO networking_nsxv3.common.synchronization [req-5d6a9703-b342-42a4-869a-af23a1d5a221 req-b55e54b3-9f98-47d0-a84c-8c3acc7bc746 service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 908.716159] env[62620]: INFO networking_nsxv3.common.synchronization [req-5d6a9703-b342-42a4-869a-af23a1d5a221 req-b55e54b3-9f98-47d0-a84c-8c3acc7bc746 service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 908.717757] env[62620]: INFO networking_nsxv3.common.synchronization [req-5d6a9703-b342-42a4-869a-af23a1d5a221 req-b55e54b3-9f98-47d0-a84c-8c3acc7bc746 service nova] Enqueued Resource ID: 8163fefd-89a3-4ff5-bbc9-e1561f91bc68 with Priority: HIGHEST for action port [ 908.717757] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 908.717757] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 908.717757] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8163fefd-89a3-4ff5-bbc9-e1561f91bc68 with Priority: HIGHEST for action port [ 908.718689] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.718689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.718689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.718689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.719996] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.720935] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.721320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.723357] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.724776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.724776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.724776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.724776] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8163fefd-89a3-4ff5-bbc9-e1561f91bc68',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.935200] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 908.935485] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 908.935617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.935821] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.936072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.936266] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.936410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.936522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.936681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.936780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.936907] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.171625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.171625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.171625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.171625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.171625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.171625] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 909.198474] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.200583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.200583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.200583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.200583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.207891] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 909.226278] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.226445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.228798] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8163fefd-89a3-4ff5-bbc9-e1561f91bc68 with status ACTIVE [ 909.228998] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.229318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.229401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.229612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.229704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.230158] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.230306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.230389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.230632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.230718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.231119] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.231232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.231315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.231466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.231582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.231716] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8163fefd-89a3-4ff5-bbc9-e1561f91bc68 is going to be updated. [ 909.252070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.252774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.252855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.254240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.254968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.255203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8163fefd-89a3-4ff5-bbc9-e1561f91bc68" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.422237] env[62620]: INFO networking_nsxv3.common.synchronization [None req-8511ef0b-ac92-4a49-a679-d97ee74664b8 None None] Enqueued Resource ID: 27af4d07-03a8-491f-898a-6c3c8983a1f7 with Priority: HIGHEST for action port [ 909.422500] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27af4d07-03a8-491f-898a-6c3c8983a1f7 with Priority: HIGHEST for action port [ 909.423075] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-27af4d07-03a8-491f-898a-6c3c8983a1f7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.423193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27af4d07-03a8-491f-898a-6c3c8983a1f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.423259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27af4d07-03a8-491f-898a-6c3c8983a1f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.424213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27af4d07-03a8-491f-898a-6c3c8983a1f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.424409] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27af4d07-03a8-491f-898a-6c3c8983a1f7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.443026] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.927558] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27af4d07-03a8-491f-898a-6c3c8983a1f7 [ 909.927558] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.927732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.927960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.928037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.928102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.928204] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27af4d07-03a8-491f-898a-6c3c8983a1f7 already deleted. [ 909.928290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27af4d07-03a8-491f-898a-6c3c8983a1f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.943843] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.451671] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.451958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.451958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.452253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.452452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.452518] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 910.484161] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.484161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.484161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.484337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.486191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.493123] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 911.185877] env[62620]: INFO networking_nsxv3.common.synchronization [req-f88a538a-13d6-4952-9572-28e7364b8f58 req-76d8d778-6559-4347-ba5a-d806e1115ee7 tempest-SecurityGroupRulesNegativeTestJSON-633781312 tempest-SecurityGroupRulesNegativeTestJSON-633781312-project-member] Enqueued Resource ID: 1d316554-262d-4cfb-938c-68cb5bf2104d with Priority: HIGHEST for action security_group_rules [ 911.186190] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d316554-262d-4cfb-938c-68cb5bf2104d with Priority: HIGHEST for action security_group_rules [ 911.186426] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d316554-262d-4cfb-938c-68cb5bf2104d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.186544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d316554-262d-4cfb-938c-68cb5bf2104d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.186612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d316554-262d-4cfb-938c-68cb5bf2104d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.186985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d316554-262d-4cfb-938c-68cb5bf2104d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.187255] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d316554-262d-4cfb-938c-68cb5bf2104d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.218041] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 911.218289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.219046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.219137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.219267] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.219403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.219472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.219640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.219721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.219829] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.696723] env[62620]: INFO networking_nsxv3.common.synchronization [None req-a6239df0-cb37-4220-9adb-eae80112daac None None] Enqueued Resource ID: b0a2fa64-e877-49d1-b23a-f27b86936899 with Priority: HIGHEST for action port [ 911.698691] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a2fa64-e877-49d1-b23a-f27b86936899 with Priority: HIGHEST for action port [ 911.698691] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0a2fa64-e877-49d1-b23a-f27b86936899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.698691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0a2fa64-e877-49d1-b23a-f27b86936899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.698691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0a2fa64-e877-49d1-b23a-f27b86936899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.698691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0a2fa64-e877-49d1-b23a-f27b86936899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.699122] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0a2fa64-e877-49d1-b23a-f27b86936899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.708018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.708136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.708238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.708400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.708487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.708582] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d316554-262d-4cfb-938c-68cb5bf2104d already deleted. [ 911.708666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d316554-262d-4cfb-938c-68cb5bf2104d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.722725] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.722912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.722953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.723198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.723296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.723498] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.723616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.723683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.723837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.723916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.724028] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 911.749521] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.749678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.749887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.750145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.750285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.761178] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 911.992557] env[62620]: INFO networking_nsxv3.common.synchronization [req-87854f3e-e84f-4038-b184-5f9a0e6825f7 req-b18ce8f8-cbb7-4ecd-bf4c-085c4e1749f4 tempest-SecurityGroupRulesNegativeTestJSON-633781312 tempest-SecurityGroupRulesNegativeTestJSON-633781312-project-member] Enqueued Resource ID: 1d316554-262d-4cfb-938c-68cb5bf2104d with Priority: HIGHEST for action security_group_rules [ 911.992557] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d316554-262d-4cfb-938c-68cb5bf2104d with Priority: HIGHEST for action security_group_rules [ 911.992557] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d316554-262d-4cfb-938c-68cb5bf2104d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.992557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d316554-262d-4cfb-938c-68cb5bf2104d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.992557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d316554-262d-4cfb-938c-68cb5bf2104d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.992557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d316554-262d-4cfb-938c-68cb5bf2104d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.992557] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d316554-262d-4cfb-938c-68cb5bf2104d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.201756] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0a2fa64-e877-49d1-b23a-f27b86936899 [ 912.201756] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.201756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.201756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.202279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.202279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.202279] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0a2fa64-e877-49d1-b23a-f27b86936899 already deleted. [ 912.202371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0a2fa64-e877-49d1-b23a-f27b86936899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.507293] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 912.508063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.508063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.508470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.508470] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.508596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.508596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.508739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.508821] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.509054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.509054] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.516129] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.516129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.516129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.516129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.516129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.516129] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d316554-262d-4cfb-938c-68cb5bf2104d already deleted. [ 912.516129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d316554-262d-4cfb-938c-68cb5bf2104d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.536063] env[62620]: INFO networking_nsxv3.common.synchronization [None req-f141c9f2-fcde-45b6-836d-aa485cb075d8 None None] Enqueued Resource ID: e800b1fe-1223-44b9-ad5c-016583bca464 with Priority: HIGHEST for action port [ 912.536334] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e800b1fe-1223-44b9-ad5c-016583bca464 with Priority: HIGHEST for action port [ 912.537402] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-e800b1fe-1223-44b9-ad5c-016583bca464 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.537402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e800b1fe-1223-44b9-ad5c-016583bca464" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.537402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e800b1fe-1223-44b9-ad5c-016583bca464" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.537600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e800b1fe-1223-44b9-ad5c-016583bca464" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.537600] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e800b1fe-1223-44b9-ad5c-016583bca464',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.011698] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.012065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.012065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.012463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.012733] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.012903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.013023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.013279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.013423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.013634] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.013977] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.014132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.014198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.014500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.014783] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.015257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.015257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.015568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.015568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.015707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.015896] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.043719] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e800b1fe-1223-44b9-ad5c-016583bca464 [ 913.048689] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.048689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.048689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.048689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.048689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.048689] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e800b1fe-1223-44b9-ad5c-016583bca464 already deleted. [ 913.048689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e800b1fe-1223-44b9-ad5c-016583bca464" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.415070] env[62620]: INFO networking_nsxv3.common.synchronization [req-984eae37-fe79-4d36-9fa0-d8596dd2f782 req-04ec35cb-2cf7-48dd-9a4a-5b46daafcc19 tempest-ServerAddressesNegativeTestJSON-609171485 tempest-ServerAddressesNegativeTestJSON-609171485-project-member] Enqueued Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGHEST for action security_group_members [ 913.415740] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGHEST for action security_group_members [ 913.416105] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27b32b5-c396-4e4a-8708-8560672f7010 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.416274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.416312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.416529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.416940] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.417662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.417751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.417930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.418033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.418136] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27b32b5-c396-4e4a-8708-8560672f7010',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.520202] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c469d6d-346a-40a2-adb5-8c50f7758224: rpc.has_security_group_logging(os_id): False [ 913.538314] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.538509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.538611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.538997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.539148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.540040] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.540040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.540040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.540040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.540040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.540339] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.540487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.540587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.540808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.540930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.541227] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.541373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.541587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.542125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.542125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.542125] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 913.605541] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.605690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.605862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.605974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.606148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.619093] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 913.767634] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 913.768113] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e deletion is rescheduled due to dependency. [ 913.768298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.768554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.768825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.769159] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.769267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.769372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.769622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.769750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.769905] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.924322] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.924641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.924717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.924973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.925102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.925446] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.925446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.925563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.926322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.926322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.926322] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27b32b5-c396-4e4a-8708-8560672f7010 is going to be updated. [ 913.969991] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.970169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.970169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.970493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.970585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.986531] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27b32b5-c396-4e4a-8708-8560672f7010 in Status: IN_PROGRESS for 2s [ 914.273531] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.273817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.273817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.273990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.274099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.274307] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.274437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.274509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.274670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.274749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.274836] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 914.300951] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.301117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.301191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.301396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.301536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.309254] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 915.236301] env[62620]: INFO networking_nsxv3.common.synchronization [None req-fe9b1e62-badd-433c-a431-1ca527be4c60 None None] Enqueued Resource ID: 55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f with Priority: HIGHEST for action port [ 915.236983] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f with Priority: HIGHEST for action port [ 915.238880] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.239013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.239208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.239400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.239481] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.632667] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 915.633061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.741758] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f [ 915.742391] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.742391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.742391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.742391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.742605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.742605] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f already deleted. [ 915.742605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55b9ef28-e0d2-4bc7-99cf-5c9ba422d25f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.000237] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27b32b5-c396-4e4a-8708-8560672f7010 in Status: SUCCESS [ 916.000237] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27b32b5-c396-4e4a-8708-8560672f7010 deletion is rescheduled due to dependency. [ 916.000237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.319319] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 916.319945] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e deletion is rescheduled due to dependency. [ 916.319945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.337699] env[62620]: INFO networking_nsxv3.common.synchronization [None req-0cfa4b40-e8d0-4f63-8346-5df208f07902 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_rules [ 916.339161] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_rules [ 916.339659] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fddb815e-1994-464a-8450-9db44691d6ac taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.339777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.339856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.340495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.340495] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.350872] env[62620]: INFO networking_nsxv3.common.synchronization [None req-5e889105-e1ef-46a5-abbb-b0be2fa6f978 None None] Enqueued Resource ID: 6d191666-cacd-4a33-bda4-d51a72126743 with Priority: HIGHEST for action port [ 916.351418] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d191666-cacd-4a33-bda4-d51a72126743 with Priority: HIGHEST for action port [ 916.351752] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d191666-cacd-4a33-bda4-d51a72126743 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.351886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d191666-cacd-4a33-bda4-d51a72126743" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.351956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d191666-cacd-4a33-bda4-d51a72126743" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.353246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d191666-cacd-4a33-bda4-d51a72126743" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.353411] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d191666-cacd-4a33-bda4-d51a72126743',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.574099] env[62620]: INFO networking_nsxv3.common.synchronization [None req-9edbaf19-4358-44cb-87d6-5127cda706e4 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_rules [ 916.574564] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_rules [ 916.574965] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fddb815e-1994-464a-8450-9db44691d6ac taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.575145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.855496] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d191666-cacd-4a33-bda4-d51a72126743 [ 916.855981] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.855981] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.855981] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.856188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.857062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.857062] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d191666-cacd-4a33-bda4-d51a72126743 already deleted. [ 916.857062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d191666-cacd-4a33-bda4-d51a72126743" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.861374] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.861531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.861603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.861805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.861893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.861985] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fddb815e-1994-464a-8450-9db44691d6ac already deleted. [ 916.862109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.862236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.862410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.862536] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.394979] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.396270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.396270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.396270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.396270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.396270] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fddb815e-1994-464a-8450-9db44691d6ac already deleted. [ 917.396270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.803226] env[62620]: INFO networking_nsxv3.common.synchronization [req-d1c57c5a-4b95-4f26-9738-2cd863406721 req-318b1b59-fa83-4717-b192-ee0125e667de tempest-ServerRescueNegativeTestJSON-1339547319 tempest-ServerRescueNegativeTestJSON-1339547319-project-member] Enqueued Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_members [ 917.803416] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_members [ 917.803716] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.803954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.803954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.804982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.805179] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.805299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.805365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.805784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.805784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.805784] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.216581] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.216936] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.216996] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.217260] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.217579] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.217705] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.217820] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.219069] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.219069] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.219981] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.219981] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.219981] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.219981] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.219981] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.219981] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.220329] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.239344] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.239538] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 918.239676] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.239854] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-887" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.240217] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-62b171c6-c991-4816-86e3-ba8a0862f911 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.241343] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-62b171c6-c991-4816-86e3-ba8a0862f911" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.241343] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-62b171c6-c991-4816-86e3-ba8a0862f911" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.243067] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-62b171c6-c991-4816-86e3-ba8a0862f911" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.243564] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62b171c6-c991-4816-86e3-ba8a0862f911',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.309991] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.309991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.309991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.309991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.309991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.309991] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.309991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.309991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.309991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.309991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.309991] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33d974dd-1e63-4b84-ae24-738b194f0483 already deleted. [ 918.309991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.722341] env[62620]: INFO networking_nsxv3.common.synchronization [None req-23a1809c-eb43-4877-a9ba-103491b773e5 None None] Enqueued Resource ID: 973aac13-610d-4a41-a387-77cffdd5ddce with Priority: HIGHEST for action port [ 918.723077] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 973aac13-610d-4a41-a387-77cffdd5ddce with Priority: HIGHEST for action port [ 918.723212] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-973aac13-610d-4a41-a387-77cffdd5ddce taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.723341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-973aac13-610d-4a41-a387-77cffdd5ddce" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.723417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-973aac13-610d-4a41-a387-77cffdd5ddce" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.725316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-973aac13-610d-4a41-a387-77cffdd5ddce" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.725316] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('973aac13-610d-4a41-a387-77cffdd5ddce',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.747169] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.747403] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.747526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.747903] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.747971] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.748145] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 62b171c6-c991-4816-86e3-ba8a0862f911 not found, creating... [ 918.748696] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.748696] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.748951] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.749310] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.749471] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.749786] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.749954] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.751560] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.751773] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.751948] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.752126] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 62b171c6-c991-4816-86e3-ba8a0862f911 is going to be created. [ 918.771629] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.775117] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.775337] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.775643] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.775911] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.776186] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-62b171c6-c991-4816-86e3-ba8a0862f911" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.864690] env[62620]: INFO networking_nsxv3.common.synchronization [req-57d41992-3480-45de-bd64-78a5467b8811 req-14653311-f122-472e-ae6b-1971f5f001c5 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 918.864885] env[62620]: INFO networking_nsxv3.common.synchronization [req-57d41992-3480-45de-bd64-78a5467b8811 req-14653311-f122-472e-ae6b-1971f5f001c5 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGHEST for action security_group_members [ 918.865052] env[62620]: INFO networking_nsxv3.common.synchronization [req-57d41992-3480-45de-bd64-78a5467b8811 req-14653311-f122-472e-ae6b-1971f5f001c5 tempest-SecurityGroupsTestJSON-1783259876 tempest-SecurityGroupsTestJSON-1783259876-project-member] Enqueued Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 918.865729] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGHEST for action security_group_members [ 918.865941] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGHEST for action security_group_members [ 918.867434] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGHEST for action security_group_members [ 918.867434] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.867434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.867434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.867434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.867434] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.867434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.867434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.867434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.868712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.868712] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.868712] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.868712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.868712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.868910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.868967] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.869069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.869153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.869319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.869361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.869444] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.870225] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.870360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.870435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.870637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.870712] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.870791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.870967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.870967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.871287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.871287] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.229247] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 973aac13-610d-4a41-a387-77cffdd5ddce [ 919.229247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.229247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.229716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.229716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.229716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.229813] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:973aac13-610d-4a41-a387-77cffdd5ddce already deleted. [ 919.229813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-973aac13-610d-4a41-a387-77cffdd5ddce" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.372950] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.373198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.373256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.373579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.373757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.374016] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.374207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.374207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.374543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.374660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.374756] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be updated. [ 919.376256] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.376367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.376435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.376622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.377760] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.377854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.398228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.398566] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.398746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.398860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.399173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.399302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.399437] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 is going to be updated. [ 919.400883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.401111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.405571] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.405722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.405766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.405972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.406355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.414610] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: IN_PROGRESS for 2s [ 919.423379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.423683] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.423815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.423872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.424165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.424335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.424335] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2320ca1-0555-4101-b523-0afb30ca04f0 is going to be updated. [ 919.431429] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.431587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.431644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.431887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.432022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.438734] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 in Status: IN_PROGRESS for 2s [ 919.452343] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.452537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.452602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.453037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.453037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.463684] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: IN_PROGRESS for 2s [ 919.639388] env[62620]: INFO networking_nsxv3.common.synchronization [req-d1c57c5a-4b95-4f26-9738-2cd863406721 req-ec1beea5-743e-436f-9b1d-e85ba4a5bde0 service nova] Enqueued Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_rules [ 919.639388] env[62620]: INFO networking_nsxv3.common.synchronization [req-d1c57c5a-4b95-4f26-9738-2cd863406721 req-ec1beea5-743e-436f-9b1d-e85ba4a5bde0 service nova] Enqueued Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_members [ 919.639388] env[62620]: INFO networking_nsxv3.common.synchronization [req-d1c57c5a-4b95-4f26-9738-2cd863406721 req-ec1beea5-743e-436f-9b1d-e85ba4a5bde0 service nova] Enqueued Resource ID: 62b171c6-c991-4816-86e3-ba8a0862f911 with Priority: HIGHEST for action port [ 919.639388] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_rules [ 919.639388] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_members [ 919.639696] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b171c6-c991-4816-86e3-ba8a0862f911 with Priority: HIGHEST for action port [ 919.640502] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.640598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.640666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.640852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.640936] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.645423] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.645698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.645698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.645896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.646090] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.646188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.646254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.646387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.646472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.646574] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.647523] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-62b171c6-c991-4816-86e3-ba8a0862f911 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.647631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62b171c6-c991-4816-86e3-ba8a0862f911" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.648186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62b171c6-c991-4816-86e3-ba8a0862f911" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.648186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62b171c6-c991-4816-86e3-ba8a0862f911" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.648186] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62b171c6-c991-4816-86e3-ba8a0862f911',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.961025] env[62620]: INFO networking_nsxv3.common.synchronization [req-322ff823-8468-4e75-a042-b370d3032725 req-ec37cee3-e0dd-4156-bedd-bc01ac0e45b1 tempest-ListImageFiltersTestJSON-306267884 tempest-ListImageFiltersTestJSON-306267884-project-member] Enqueued Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 919.961025] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 919.961025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.961025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.961025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.961025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.961025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.961025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.961025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.962112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.962415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.962679] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.150047] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.150047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.157025] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62b171c6-c991-4816-86e3-ba8a0862f911 with status ACTIVE [ 920.157025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.157025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.157025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.157025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.157025] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62b171c6-c991-4816-86e3-ba8a0862f911 is going to be updated. [ 920.157707] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.189520] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.190262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.190536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.190876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.191167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.191542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62b171c6-c991-4816-86e3-ba8a0862f911" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.236128] env[62620]: INFO networking_nsxv3.common.synchronization [req-937c4826-e746-4a65-8c0b-a24aaf6ef7ed req-c1d44876-8940-4a77-a201-31cc67209b61 tempest-ServersTestManualDisk-1682543278 tempest-ServersTestManualDisk-1682543278-project-member] Enqueued Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_members [ 920.236128] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_members [ 920.236128] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9338b344-e20e-4f2c-889d-3246eaae326d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.236128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.236128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.236128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.236128] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.236880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.237109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.237389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.238258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.238496] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.465038] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.472481] env[62620]: INFO networking_nsxv3.common.synchronization [None req-ea3cdc3b-78a7-43e4-8b05-be13ec058dde tempest-ServersWithSpecificFlavorTestJSON-1227304686 tempest-ServersWithSpecificFlavorTestJSON-1227304686-project-member] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_rules [ 920.472976] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_rules [ 920.473295] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.473424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.473496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.473733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.473814] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.569975] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.570328] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-153" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.570433] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-153" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.571353] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-153" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.571845] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.572206] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.572206] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.572449] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.572764] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.573060] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.573285] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.573938] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.574240] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.574697] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.574840] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.575054] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.592629] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.592816] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.592993] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.593295] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-153" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.593700] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-3dc09d47-bf2c-4769-96df-8bc30f2bb658 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.593910] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-3dc09d47-bf2c-4769-96df-8bc30f2bb658" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.594051] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-3dc09d47-bf2c-4769-96df-8bc30f2bb658" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.594386] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-3dc09d47-bf2c-4769-96df-8bc30f2bb658" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.594591] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc09d47-bf2c-4769-96df-8bc30f2bb658',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.649226] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b417093d-d2a5-4f1c-89aa-c8044e5d0354 tempest-ServersWithSpecificFlavorTestJSON-1227304686 tempest-ServersWithSpecificFlavorTestJSON-1227304686-project-member] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_rules [ 920.649715] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_rules [ 920.650150] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.650150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.662871] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.740411] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.740591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.740631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.740860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.740951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.741363] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.741483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.741548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.741711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.741788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.741872] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9338b344-e20e-4f2c-889d-3246eaae326d already deleted. [ 920.741949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.968472] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.995842] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.996105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.996187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.996439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.996541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.996647] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f already deleted. [ 920.996736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.997077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.997151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.997184] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.097858] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.097858] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.097858] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.097858] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.098063] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.098183] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 3dc09d47-bf2c-4769-96df-8bc30f2bb658 not found, creating... [ 921.098704] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.098704] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.098867] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.099036] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.099181] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.099497] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.099683] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.099807] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.102134] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.102134] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.102134] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 3dc09d47-bf2c-4769-96df-8bc30f2bb658 is going to be created. [ 921.121764] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.122040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.122250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.122610] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.122927] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.123245] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-3dc09d47-bf2c-4769-96df-8bc30f2bb658" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.164494] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.164764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.164764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.164996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.165109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.165221] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33d974dd-1e63-4b84-ae24-738b194f0483 is going to be created. [ 921.204190] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.204401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.204467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.204694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.204870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.220598] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33d974dd-1e63-4b84-ae24-738b194f0483 in Status: UNINITIALIZED for 2s [ 921.423894] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daf462fc-bab6-4357-af22-b6d35dd411dd in Status: SUCCESS [ 921.423894] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd deletion is rescheduled due to dependency. [ 921.423894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.448862] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 in Status: SUCCESS [ 921.448862] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 deletion is rescheduled due to dependency. [ 921.448862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.472184] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2320ca1-0555-4101-b523-0afb30ca04f0 in Status: SUCCESS [ 921.472184] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2320ca1-0555-4101-b523-0afb30ca04f0 deletion is rescheduled due to dependency. [ 921.472184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.472448] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.472778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.472778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.472896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.472896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.473922] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c72dcb51-694a-46ed-b921-12a44f522163 is going to be updated. [ 921.497854] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.497982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.497982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.498332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.498332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.519700] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.519700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.519700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.519925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.520034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.520157] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f already deleted. [ 921.520258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.522394] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: IN_PROGRESS for 2s [ 922.119029] env[62620]: INFO networking_nsxv3.common.synchronization [req-937c4826-e746-4a65-8c0b-a24aaf6ef7ed req-d9c8e7bd-b1d8-4bed-8db4-d50588b8ba83 service nova] Enqueued Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_rules [ 922.119221] env[62620]: INFO networking_nsxv3.common.synchronization [req-937c4826-e746-4a65-8c0b-a24aaf6ef7ed req-d9c8e7bd-b1d8-4bed-8db4-d50588b8ba83 service nova] Enqueued Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_members [ 922.119365] env[62620]: INFO networking_nsxv3.common.synchronization [req-937c4826-e746-4a65-8c0b-a24aaf6ef7ed req-d9c8e7bd-b1d8-4bed-8db4-d50588b8ba83 service nova] Enqueued Resource ID: 3dc09d47-bf2c-4769-96df-8bc30f2bb658 with Priority: HIGHEST for action port [ 922.119602] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_rules [ 922.119745] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_members [ 922.119861] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc09d47-bf2c-4769-96df-8bc30f2bb658 with Priority: HIGHEST for action port [ 922.125397] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9338b344-e20e-4f2c-889d-3246eaae326d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.125397] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.125397] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9338b344-e20e-4f2c-889d-3246eaae326d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.125397] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.125397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.125397] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.125397] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dc09d47-bf2c-4769-96df-8bc30f2bb658 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.128957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dc09d47-bf2c-4769-96df-8bc30f2bb658" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.128957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dc09d47-bf2c-4769-96df-8bc30f2bb658" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.128957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dc09d47-bf2c-4769-96df-8bc30f2bb658" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.128957] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc09d47-bf2c-4769-96df-8bc30f2bb658',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.633242] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.634960] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9338b344-e20e-4f2c-889d-3246eaae326d taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.635120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.637511] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dc09d47-bf2c-4769-96df-8bc30f2bb658 with status ACTIVE [ 922.637511] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.637511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.638041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.638733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.638849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.640219] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.640219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.640219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.640718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.640807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.641032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.642204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.642655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.643047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.643047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.643047] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dc09d47-bf2c-4769-96df-8bc30f2bb658 is going to be updated. [ 922.666403] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.666615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.666661] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.666895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.667067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.667217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dc09d47-bf2c-4769-96df-8bc30f2bb658" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.034260] env[62620]: INFO networking_nsxv3.common.synchronization [req-da634f2f-99d7-4268-b120-9667049234eb req-41b021d1-0f34-43dd-946c-b479d9b43301 tempest-ServerRescueTestJSON-1890721172 tempest-ServerRescueTestJSON-1890721172-project-member] Enqueued Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 923.034904] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 923.035146] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.035264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.035334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.035686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.035742] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.035804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.035900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.036011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.036090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.036186] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.136171] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.229823] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33d974dd-1e63-4b84-ae24-738b194f0483 in Status: SUCCESS [ 923.230047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.230234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.231990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.231990] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.231990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.231990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.231990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.231990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.231990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.231990] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.532047] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: SUCCESS [ 923.532731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.538764] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.599449] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.599662] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-293" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.599799] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-293" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.600122] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-293" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.603799] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.603799] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.603799] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.603799] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.603799] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.603799] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 923.603799] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.603799] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.603799] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.603799] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 923.603799] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.603799] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.622165] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.622165] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 923.622165] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.622165] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-293" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.622165] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-e7de9fde-1309-4a6a-bbb5-537333d9e42c taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.622165] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-e7de9fde-1309-4a6a-bbb5-537333d9e42c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.622165] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-e7de9fde-1309-4a6a-bbb5-537333d9e42c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.622707] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-e7de9fde-1309-4a6a-bbb5-537333d9e42c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.623010] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7de9fde-1309-4a6a-bbb5-537333d9e42c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.639076] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.639378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.640746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.640746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.640746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.640746] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9338b344-e20e-4f2c-889d-3246eaae326d is going to be created. [ 923.662720] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.662720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.662720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.662953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.662953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.673089] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9338b344-e20e-4f2c-889d-3246eaae326d in Status: UNINITIALIZED for 2s [ 923.736025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.895466] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.895628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.895854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.896149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.896315] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.041823] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.125929] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.127115] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.127115] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.127115] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.127115] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.127115] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port e7de9fde-1309-4a6a-bbb5-537333d9e42c not found, creating... [ 924.127344] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.127478] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.127478] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.127760] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.129909] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.129909] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.129909] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.129909] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.129909] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.129909] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.129909] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: e7de9fde-1309-4a6a-bbb5-537333d9e42c is going to be created. [ 924.153378] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.153490] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.153611] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.153914] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.154161] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.154375] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-e7de9fde-1309-4a6a-bbb5-537333d9e42c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.239919] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33d974dd-1e63-4b84-ae24-738b194f0483: rpc.has_security_group_logging(os_id): False [ 924.270794] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.271167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.271607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.272134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.272384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.272813] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.273864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.273864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.273864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.273864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.273864] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33d974dd-1e63-4b84-ae24-738b194f0483 is going to be created. [ 924.338310] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.338643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.338739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.338971] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.339229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.351605] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33d974dd-1e63-4b84-ae24-738b194f0483 in Status: IN_PROGRESS for 2s [ 924.398470] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.547651] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.547651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.547651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.547651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.547651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.547651] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 is going to be updated. [ 924.598146] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.598146] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.598146] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.598146] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.598425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.606417] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: IN_PROGRESS for 2s [ 924.907497] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.970840] env[62620]: INFO networking_nsxv3.common.synchronization [req-1d35545e-d84c-41b3-acf8-65a4c5576943 req-0702e711-c15c-4356-8fc2-7d173a740892 tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 924.971405] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 924.971725] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.971851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.971912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.975458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.975727] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.975817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.975881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.976056] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.976156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.976263] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.068643] env[62620]: INFO networking_nsxv3.common.synchronization [req-da634f2f-99d7-4268-b120-9667049234eb req-bd24f77f-e756-4621-b585-f3e68013346e service nova] Enqueued Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_rules [ 925.068643] env[62620]: INFO networking_nsxv3.common.synchronization [req-da634f2f-99d7-4268-b120-9667049234eb req-bd24f77f-e756-4621-b585-f3e68013346e service nova] Enqueued Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 925.068643] env[62620]: INFO networking_nsxv3.common.synchronization [req-da634f2f-99d7-4268-b120-9667049234eb req-bd24f77f-e756-4621-b585-f3e68013346e service nova] Enqueued Resource ID: e7de9fde-1309-4a6a-bbb5-537333d9e42c with Priority: HIGHEST for action port [ 925.068643] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_rules [ 925.068643] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 925.068643] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7de9fde-1309-4a6a-bbb5-537333d9e42c with Priority: HIGHEST for action port [ 925.068643] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.068643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.068643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.068643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.068643] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.069038] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.069939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.070524] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7de9fde-1309-4a6a-bbb5-537333d9e42c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.070644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7de9fde-1309-4a6a-bbb5-537333d9e42c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.070716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7de9fde-1309-4a6a-bbb5-537333d9e42c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.070947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7de9fde-1309-4a6a-bbb5-537333d9e42c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.071054] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7de9fde-1309-4a6a-bbb5-537333d9e42c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.408603] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 925.408820] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 925.481028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.481028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.481028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.481028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.481028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.481028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.481028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.481028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.481028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.481028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.481028] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 925.511252] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.511844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.511844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.511844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.512066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.523889] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 925.572551] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.572734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.573105] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7de9fde-1309-4a6a-bbb5-537333d9e42c with status ACTIVE [ 925.573377] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.573463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.573500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.573751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.573817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.574063] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.574063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.574158] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.574638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.574638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.574638] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.574808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.574808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.574902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.574966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.575035] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7de9fde-1309-4a6a-bbb5-537333d9e42c is going to be updated. [ 925.613083] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.613083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.613083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.613083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.613083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.613083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7de9fde-1309-4a6a-bbb5-537333d9e42c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.716234] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9338b344-e20e-4f2c-889d-3246eaae326d in Status: SUCCESS [ 925.716594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.717373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.717715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.719163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.719163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.719163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.719163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.719163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.719163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.719163] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.151733] env[62620]: INFO networking_nsxv3.common.synchronization [req-36f813a5-8971-4cb9-953e-e3c96a530892 req-3843ac80-52f5-494d-9d94-d85c42b7cd20 tempest-ServerDiagnosticsTest-533968786 tempest-ServerDiagnosticsTest-533968786-project-member] Enqueued Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGHEST for action security_group_members [ 926.153084] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGHEST for action security_group_members [ 926.153084] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9631f352-d470-4c89-91c3-5135b61e37bb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.153213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.153343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.153659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.153879] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.154046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.154148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.154448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.154448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.154665] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9631f352-d470-4c89-91c3-5135b61e37bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.224021] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.339568] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.339678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.339750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.340105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.356743] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 926.358176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.359935] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 926.374884] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33d974dd-1e63-4b84-ae24-738b194f0483 in Status: SUCCESS [ 926.375200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.392101] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.392351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.392351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.392643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.399235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.399799] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 926.399885] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 926.399971] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 926.433112] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.433112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.433112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.433292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.434097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.434282] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 926.495325] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.495325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.495325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.495560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.496144] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.496254] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 926.517409] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.517611] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.517738] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.518016] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.518277] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.518432] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.518556] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.518789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.518941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.519160] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.519275] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.519383] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.519490] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.519600] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.519705] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.519993] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.538645] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.538800] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 926.538940] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.539122] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.539416] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.539584] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.539729] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.540047] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.540188] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.568457] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.568625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.568664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.568861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.569149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.569333] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:33. [ 926.569399] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ec0ace76-b963-4700-a56b-d0352431deaf', '8f72e34a-6fab-4bd8-b5cb-722a902c51c1', 'c27b32b5-c396-4e4a-8708-8560672f7010', 'c2320ca1-0555-4101-b523-0afb30ca04f0', '95e0473d-1c6d-4b24-a6d9-f419a29f67f5', '32910d79-8601-44ca-ba8c-4e47ddc77063', '5055d880-77be-4c89-8a2a-a2e60908e12a', 'e5648415-b62c-4796-a92a-229b5e585bfa', '33d974dd-1e63-4b84-ae24-738b194f0483', '202f6ed5-23fc-4a56-be57-1b3daf0aed84', 'aa37dde5-b59c-4c95-8712-27727dd6ae4e', 'daf462fc-bab6-4357-af22-b6d35dd411dd', '8623cf30-8f12-4744-a839-bb17de78b876', '1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89', '6c995751-5151-4812-a1e5-510ea09222e0', '341c1f60-30e8-4cc4-ae8a-741cd6542553', '46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217', '20f5a061-dbd0-44d6-953b-0f455ddef899', 'c496017c-beee-4fd7-8921-2f61e9ddb89b', '0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff', '787f7736-c1a9-4a6d-8e59-532c4a82467e', '4a6af52c-b1fd-4489-b26c-557260173089', 'e8ef3419-3f65-45f7-8a65-b4c2453d9fb8', '255ec5a6-942e-49be-b759-c091160337f6', '7027a4f2-13d4-467a-96da-8c378fa8ac69', '0a74e416-c2f5-41f6-a7d3-a2cd9c682858', 'b140e556-13f7-4e22-a7d6-53ddc3943100', '7c469d6d-346a-40a2-adb5-8c50f7758224', 'b27f6472-ff8f-4e87-ba84-3f06d7d9c925', '84776719-6313-41bf-88fe-129baf34c6ed', '16d45250-e90b-4ed6-befa-bdaacfced30b', 'b2bbf04f-3b75-4f98-a58c-b7dfe66747dd', 'c72dcb51-694a-46ed-b921-12a44f522163'} {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 926.569497] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 926.587662] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.587898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.587898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.588074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.588074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.588187] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 926.588249] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 926.588317] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 926.622574] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: SUCCESS [ 926.622855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.623443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.623672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.623863] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.623981] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.624054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.624608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.624608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.624608] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.657169] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.657242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.657315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.657553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.657620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.657839] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.657898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.657933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.658100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.658184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.658249] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9631f352-d470-4c89-91c3-5135b61e37bb already deleted. [ 926.658328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.686071] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.686249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.686317] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.686546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.687358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.687601] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 926.687704] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 926.687815] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 926.687901] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 926.687996] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/33 resources of Type:Security Group Rules [ 926.688108] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGH for action security_group_rules [ 926.688206] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGH for action security_group_rules [ 926.688576] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGH for action security_group_rules [ 926.688576] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGH for action security_group_rules [ 926.688576] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGH for action security_group_rules [ 926.688576] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGH for action security_group_rules [ 926.688576] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGH for action security_group_rules [ 926.688576] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGH for action security_group_rules [ 926.688764] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGH for action security_group_rules [ 926.688764] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGH for action security_group_rules [ 926.688764] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGH for action security_group_rules [ 926.688908] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGH for action security_group_rules [ 926.688908] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGH for action security_group_rules [ 926.688908] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGH for action security_group_rules [ 926.689011] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGH for action security_group_rules [ 926.689011] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGH for action security_group_rules [ 926.689132] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGH for action security_group_rules [ 926.689240] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGH for action security_group_rules [ 926.689333] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGH for action security_group_rules [ 926.689414] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGH for action security_group_rules [ 926.689532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.726093] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9338b344-e20e-4f2c-889d-3246eaae326d: rpc.has_security_group_logging(os_id): False [ 926.744319] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.744559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.744875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.744875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.745124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.745286] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.745381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.745381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.745538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.745611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.745723] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9338b344-e20e-4f2c-889d-3246eaae326d is going to be created. [ 926.810419] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.810597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.810696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.810951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.811153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.824677] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9338b344-e20e-4f2c-889d-3246eaae326d in Status: IN_PROGRESS for 2s [ 927.042869] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.043069] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.043329] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.043642] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.043911] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.045263] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14 not found, creating... [ 927.045263] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.045263] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.045263] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.045263] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.045263] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.045587] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.045738] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.045858] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.046725] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.046903] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.047084] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14 is going to be created. [ 927.069157] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.069249] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.069522] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.069846] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.070092] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.070319] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.126727] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.533865] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 927.534217] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 deletion is rescheduled due to dependency. [ 927.534217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.628650] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.024247] env[62620]: INFO networking_nsxv3.common.synchronization [req-36f813a5-8971-4cb9-953e-e3c96a530892 req-4b44f8de-d84c-47bc-9e9c-059d6ebf4075 service nova] Enqueued Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGHEST for action security_group_rules [ 928.024465] env[62620]: INFO networking_nsxv3.common.synchronization [req-36f813a5-8971-4cb9-953e-e3c96a530892 req-4b44f8de-d84c-47bc-9e9c-059d6ebf4075 service nova] Enqueued Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGHEST for action security_group_members [ 928.024640] env[62620]: INFO networking_nsxv3.common.synchronization [req-36f813a5-8971-4cb9-953e-e3c96a530892 req-4b44f8de-d84c-47bc-9e9c-059d6ebf4075 service nova] Enqueued Resource ID: 7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14 with Priority: HIGHEST for action port [ 928.024873] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGHEST for action security_group_rules [ 928.025021] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGHEST for action security_group_members [ 928.025131] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14 with Priority: HIGHEST for action port [ 928.025231] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0ace76-b963-4700-a56b-d0352431deaf with Priority: HIGH for action security_group_rules [ 928.025329] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27b32b5-c396-4e4a-8708-8560672f7010 with Priority: HIGH for action security_group_rules [ 928.025427] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5055d880-77be-4c89-8a2a-a2e60908e12a with Priority: HIGH for action security_group_rules [ 928.025511] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGH for action security_group_rules [ 928.025612] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff with Priority: HIGH for action security_group_rules [ 928.025725] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c496017c-beee-4fd7-8921-2f61e9ddb89b with Priority: HIGH for action security_group_rules [ 928.025817] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGH for action security_group_rules [ 928.027359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 with Priority: HIGH for action security_group_rules [ 928.027359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 with Priority: HIGH for action security_group_rules [ 928.027359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 with Priority: HIGH for action security_group_rules [ 928.027359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623cf30-8f12-4744-a839-bb17de78b876 with Priority: HIGH for action security_group_rules [ 928.027359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf462fc-bab6-4357-af22-b6d35dd411dd with Priority: HIGH for action security_group_rules [ 928.027359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e with Priority: HIGH for action security_group_rules [ 928.027359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 with Priority: HIGH for action security_group_rules [ 928.027359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGH for action security_group_rules [ 928.027977] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 with Priority: HIGH for action security_group_rules [ 928.027977] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5648415-b62c-4796-a92a-229b5e585bfa with Priority: HIGH for action security_group_rules [ 928.027977] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGH for action security_group_rules [ 928.027977] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 with Priority: HIGH for action security_group_rules [ 928.028164] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2320ca1-0555-4101-b523-0afb30ca04f0 with Priority: HIGH for action security_group_rules [ 928.028931] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9631f352-d470-4c89-91c3-5135b61e37bb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.029109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.029203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.029487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.029611] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9631f352-d470-4c89-91c3-5135b61e37bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.031327] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9631f352-d470-4c89-91c3-5135b61e37bb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.031480] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.031805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.031968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.032174] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.032306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.032398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.032688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.032839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.032882] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9631f352-d470-4c89-91c3-5135b61e37bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.034535] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.034679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.034770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.035298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.035641] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.036903] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec0ace76-b963-4700-a56b-d0352431deaf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.037063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.037156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.037589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.037875] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec0ace76-b963-4700-a56b-d0352431deaf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.039409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27b32b5-c396-4e4a-8708-8560672f7010 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.039893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.039893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.039893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.040076] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27b32b5-c396-4e4a-8708-8560672f7010',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.040728] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5055d880-77be-4c89-8a2a-a2e60908e12a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.041706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.041706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.041706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.041706] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5055d880-77be-4c89-8a2a-a2e60908e12a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.042673] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.042877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.043022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.043204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.043339] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.045318] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.045318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.045318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.045318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.045318] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.045549] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c496017c-beee-4fd7-8921-2f61e9ddb89b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.045719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.045719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.046343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.047627] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c496017c-beee-4fd7-8921-2f61e9ddb89b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.047627] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.047627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.047627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.048511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.048511] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.051877] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.052361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.052767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.052971] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.053507] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.055054] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.055205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.055323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.055517] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.055615] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.056544] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341c1f60-30e8-4cc4-ae8a-741cd6542553 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.056714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.057136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.057341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.057443] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341c1f60-30e8-4cc4-ae8a-741cd6542553',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.058679] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8623cf30-8f12-4744-a839-bb17de78b876 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.058902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.059050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.059163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.059256] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8623cf30-8f12-4744-a839-bb17de78b876',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.060225] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daf462fc-bab6-4357-af22-b6d35dd411dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.060333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.060402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.060555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.060627] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daf462fc-bab6-4357-af22-b6d35dd411dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.062299] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.062414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.062486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.062639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.062713] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa37dde5-b59c-4c95-8712-27727dd6ae4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.065454] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.065454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.065454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.065454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.065454] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('202f6ed5-23fc-4a56-be57-1b3daf0aed84',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.065454] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.065454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.065454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.065924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.065924] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.066833] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32910d79-8601-44ca-ba8c-4e47ddc77063 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.066937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.067008] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.067166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.067271] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32910d79-8601-44ca-ba8c-4e47ddc77063',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.068032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5648415-b62c-4796-a92a-229b5e585bfa taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.068453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.068523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.068723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.068797] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5648415-b62c-4796-a92a-229b5e585bfa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.068963] env[62620]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 928.069634] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.069742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.069809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.069958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.070577] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.072191] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.072289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.072356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.072511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.072586] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f72e34a-6fab-4bd8-b5cb-722a902c51c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.073377] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2320ca1-0555-4101-b523-0afb30ca04f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.073486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.073551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.073702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.073765] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2320ca1-0555-4101-b523-0afb30ca04f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.091804] env[62620]: INFO networking_nsxv3.common.synchronization [None req-ead01526-36e4-498a-90b9-b3ec12ea06c4 tempest-ImagesOneServerNegativeTestJSON-1314187372 tempest-ImagesOneServerNegativeTestJSON-1314187372-project-member] Enqueued Resource ID: eebd34b0-2ff4-4691-ab69-c08325938039 with Priority: HIGHEST for action security_group_rules [ 928.095623] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eebd34b0-2ff4-4691-ab69-c08325938039 with Priority: HIGHEST for action security_group_rules [ 928.099247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eebd34b0-2ff4-4691-ab69-c08325938039 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.099388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eebd34b0-2ff4-4691-ab69-c08325938039" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.099388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eebd34b0-2ff4-4691-ab69-c08325938039" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.099691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eebd34b0-2ff4-4691-ab69-c08325938039" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.099755] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eebd34b0-2ff4-4691-ab69-c08325938039',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.117264] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.117264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.117264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.117264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.121478] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.121596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.122395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.122497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.125718] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.125718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.131371] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.131504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.131576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.131799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.131886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.131981] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 is going to be updated. [ 928.149889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.150503] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec0ace76-b963-4700-a56b-d0352431deaf is going to be deleted. [ 928.151873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.152120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.158826] env[62620]: INFO networking_nsxv3.common.synchronization [None req-91a909d9-b141-4694-ae00-f75f2709952b tempest-ImagesOneServerNegativeTestJSON-1314187372 tempest-ImagesOneServerNegativeTestJSON-1314187372-project-member] Enqueued Resource ID: eebd34b0-2ff4-4691-ab69-c08325938039 with Priority: HIGHEST for action security_group_rules [ 928.159074] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eebd34b0-2ff4-4691-ab69-c08325938039 with Priority: HIGHEST for action security_group_rules [ 928.160027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.160200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.160284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.160449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.160601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.162302] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eebd34b0-2ff4-4691-ab69-c08325938039 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.162302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eebd34b0-2ff4-4691-ab69-c08325938039" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.168283] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: IN_PROGRESS for 2s [ 928.178565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.178565] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be deleted. [ 928.178565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.178565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.203996] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.204170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.212233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.212387] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27b32b5-c396-4e4a-8708-8560672f7010 is going to be deleted. [ 928.213369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.213587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.234471] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.234650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.239930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.240072] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff is going to be deleted. [ 928.240955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.241189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.241278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.241397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec0ace76-b963-4700-a56b-d0352431deaf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.241546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.241702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.241778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.241886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.317766] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.317920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.317992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.318235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.318331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.318452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27b32b5-c396-4e4a-8708-8560672f7010" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.333621] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.333768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.333837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.334062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.334152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.334270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ac332cd-e3e4-43eb-ac6b-dac9fcfffbff" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.531528] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9631f352-d470-4c89-91c3-5135b61e37bb taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.531671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.535105] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9631f352-d470-4c89-91c3-5135b61e37bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.537900] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14 with status ACTIVE [ 928.538126] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.538254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.538354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.538543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.538635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.538807] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.538919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.538983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.539139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.539216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.539411] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.539502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.539563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.539701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.539774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.539855] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14 is going to be updated. [ 928.577811] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.578191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.578191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.578431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.581408] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.581593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.581593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.581803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.581945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.582151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e5db0e3-f97d-48f9-89bd-9d1b24ac6d14" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.601531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.601686] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5055d880-77be-4c89-8a2a-a2e60908e12a is going to be deleted. [ 928.635929] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.636203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.636203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.636885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.637125] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.637372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.637441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.637728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.637833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.637926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.638036] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.650686] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.650832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.650910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.651129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.656543] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.656715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.659187] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.659187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.703990] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.704218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.706633] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.706633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.711272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.711394] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89 is going to be deleted. [ 928.712282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.712572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.715132] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.715235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.717072] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.717200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.721323] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.721323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.728393] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.728530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.735282] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.735412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.736226] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.736334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.743161] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.743291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.745329] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.745466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.746318] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 928.746921] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.747127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.753585] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 928.754258] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.754258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.762166] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 928.762757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.762931] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daf462fc-bab6-4357-af22-b6d35dd411dd is going to be deleted. [ 928.764054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.764321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.764427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.764566] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eebd34b0-2ff4-4691-ab69-c08325938039 already deleted. [ 928.764678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eebd34b0-2ff4-4691-ab69-c08325938039" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.765692] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.765792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.765857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.766057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.767108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eebd34b0-2ff4-4691-ab69-c08325938039" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.767401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eebd34b0-2ff4-4691-ab69-c08325938039" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.767524] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eebd34b0-2ff4-4691-ab69-c08325938039',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.790767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.790895] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be deleted. [ 928.792062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.792172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.795058] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.795170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.814702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.814702] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 202f6ed5-23fc-4a56-be57-1b3daf0aed84 is going to be deleted. [ 928.815736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.815957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.821632] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.823686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.844165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.844301] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa37dde5-b59c-4c95-8712-27727dd6ae4e is going to be deleted. [ 928.845273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.845481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.871364] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9338b344-e20e-4f2c-889d-3246eaae326d in Status: SUCCESS [ 928.871364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.899306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.899484] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c496017c-beee-4fd7-8921-2f61e9ddb89b is going to be deleted. [ 928.900425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.900706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.902135] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.902259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.905194] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.905194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.955538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.955760] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be deleted. [ 928.956756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.956996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.026093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.026309] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341c1f60-30e8-4cc4-ae8a-741cd6542553 is going to be deleted. [ 929.027201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.027381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.036987] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9631f352-d470-4c89-91c3-5135b61e37bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.081315] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.081465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.090930] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.091098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.103203] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.103344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.118957] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 929.119523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.119780] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32910d79-8601-44ca-ba8c-4e47ddc77063 is going to be deleted. [ 929.120589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.120823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.140667] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.232859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.232859] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5648415-b62c-4796-a92a-229b5e585bfa is going to be deleted. [ 929.233905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.234232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.234348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.234993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5055d880-77be-4c89-8a2a-a2e60908e12a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.234993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.234993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.294081] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.294254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.311987] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.312185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.316438] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.316565] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f72e34a-6fab-4bd8-b5cb-722a902c51c1 is going to be deleted. [ 929.317495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.317710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.323520] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.323667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.367032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.367032] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2320ca1-0555-4101-b523-0afb30ca04f0 is going to be deleted. [ 929.368401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.368401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.384876] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.384876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.422443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.422583] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8623cf30-8f12-4744-a839-bb17de78b876 is going to be deleted. [ 929.423532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.423751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.441070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.441221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.469224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.469276] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217 is going to be deleted. [ 929.470291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.470524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.470618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.470746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cdd9ba1-0d3d-4ad0-a9dd-423bb9c7de89" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.471579] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.471691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.471733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.471893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.472196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.472196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2320ca1-0555-4101-b523-0afb30ca04f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.472196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.472358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.472436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.472547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daf462fc-bab6-4357-af22-b6d35dd411dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.473035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.473198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.473349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.473422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-202f6ed5-23fc-4a56-be57-1b3daf0aed84" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.473512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.473656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.473716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.473831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.473939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.474112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.474186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.474300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa37dde5-b59c-4c95-8712-27727dd6ae4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.474427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.474597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.474673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.474783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c496017c-beee-4fd7-8921-2f61e9ddb89b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.474896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.475044] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.475120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.475250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.475357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.475497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.475573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.475738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32910d79-8601-44ca-ba8c-4e47ddc77063" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.475854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.475994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.476092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.476219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341c1f60-30e8-4cc4-ae8a-741cd6542553" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.476351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.476489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.476565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.476660] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eebd34b0-2ff4-4691-ab69-c08325938039 already deleted. [ 929.476736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eebd34b0-2ff4-4691-ab69-c08325938039" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.476869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.477030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.477106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.477204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5648415-b62c-4796-a92a-229b5e585bfa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.477335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.477477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.477541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.477653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f72e34a-6fab-4bd8-b5cb-722a902c51c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.539672] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.539957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.539957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.540159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.540244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.541325] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9631f352-d470-4c89-91c3-5135b61e37bb is going to be created. [ 929.542218] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.542343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.542833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.542833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.542833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.542833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8623cf30-8f12-4744-a839-bb17de78b876" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.615712] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.615928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.615928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.616165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.616356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.618088] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.618207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.618276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.618453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.618545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.618662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46eb1e3c-97fb-4b5a-95aa-bf1ac1deb217" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.632348] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 929.632774] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9631f352-d470-4c89-91c3-5135b61e37bb in Status: UNINITIALIZED for 2s [ 929.643247] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33d974dd-1e63-4b84-ae24-738b194f0483: rpc.has_security_group_logging(os_id): False [ 929.691977] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.692207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.692207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.692425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.747109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.747484] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.747613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.747684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.747908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.747994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.748120] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33d974dd-1e63-4b84-ae24-738b194f0483 is going to be updated. [ 929.833997] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.834167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.834211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.834418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.834592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.846875] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33d974dd-1e63-4b84-ae24-738b194f0483 in Status: IN_PROGRESS for 2s [ 930.179523] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: SUCCESS [ 930.179523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.179523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.179523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.179523] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.180245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.180566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.180944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.181251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.181533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.182780] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.687447] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.687812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.687812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.687929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.688050] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.688152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.688323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.688380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.688437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.688521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.688686] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.688766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.688918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.688977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.689121] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.689216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.689267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.689406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.689482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.689562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.689650] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.191854] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b27f6472-ff8f-4e87-ba84-3f06d7d9c925: rpc.has_security_group_logging(os_id): False [ 931.211313] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.211569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.211569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.211755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.234205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.234417] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.234659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.234744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.234958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.235160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.235411] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.235411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.235411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.235696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.235696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.235838] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.235951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.236047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.236142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.236237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.236310] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 is going to be updated. [ 931.296150] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.296327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.296407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.296672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.296824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.308534] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: IN_PROGRESS for 2s [ 931.643385] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9631f352-d470-4c89-91c3-5135b61e37bb in Status: SUCCESS [ 931.643535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.643994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.644275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.644571] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.645184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.645184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.645184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.645184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.645184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.645424] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9631f352-d470-4c89-91c3-5135b61e37bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.862613] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33d974dd-1e63-4b84-ae24-738b194f0483 in Status: SUCCESS [ 931.862907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.151022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9631f352-d470-4c89-91c3-5135b61e37bb taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.151022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.151022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9631f352-d470-4c89-91c3-5135b61e37bb taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.151022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.151680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.151680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.151680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.151680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.151680] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9631f352-d470-4c89-91c3-5135b61e37bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.652688] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9631f352-d470-4c89-91c3-5135b61e37bb: rpc.has_security_group_logging(os_id): False [ 932.672745] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.672898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.673277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.673277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.673396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.673521] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.673625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.673687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.673840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.673915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.674112] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.674207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.674269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.674409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.674481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.674705] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.674839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.674911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.675051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.675132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.675218] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9631f352-d470-4c89-91c3-5135b61e37bb is going to be created. [ 932.738309] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.738585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.738585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.738739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.738912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.748550] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9631f352-d470-4c89-91c3-5135b61e37bb in Status: IN_PROGRESS for 2s [ 933.160194] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 933.160194] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 933.322281] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: SUCCESS [ 933.322281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.357512] env[62620]: INFO networking_nsxv3.common.synchronization [req-048bd3cb-f9ad-4be1-bab6-addfc949e805 req-e29c52d5-5ccb-4c2a-b67e-4ed43204cc29 tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 933.357942] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 933.358265] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.358383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.358518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.358651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.358800] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.359172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.359172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.359172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.359172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.359342] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.861582] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.861796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.861955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.862277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.883461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.884208] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.884208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.884208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.884638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.884638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.884638] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 933.910705] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.910978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.910978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.911177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.911346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.919913] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 934.761196] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9631f352-d470-4c89-91c3-5135b61e37bb in Status: SUCCESS [ 934.761526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.929837] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 935.929837] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 935.930253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.359409] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 938.359675] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 938.439732] env[62620]: INFO networking_nsxv3.common.synchronization [req-f87ae548-ed88-4a62-b117-0d50b6e05974 req-2131d75b-82de-47c6-bdae-4716ed8b9aec tempest-ServersAdminTestJSON-158660873 tempest-ServersAdminTestJSON-158660873-project-member] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 938.440195] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 938.440562] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.440722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.440809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.441165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.441343] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.441457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.441496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.441671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.441776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.441846] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.669037] env[62620]: INFO networking_nsxv3.common.synchronization [None req-2224ad2e-1646-43c3-a0a6-50ba31680739 None None] Enqueued Resource ID: 6b951820-a6aa-49c1-94ed-5b2f9648d600 with Priority: HIGHEST for action port [ 938.669341] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b951820-a6aa-49c1-94ed-5b2f9648d600 with Priority: HIGHEST for action port [ 938.669913] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b951820-a6aa-49c1-94ed-5b2f9648d600 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.670063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b951820-a6aa-49c1-94ed-5b2f9648d600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.670132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b951820-a6aa-49c1-94ed-5b2f9648d600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.672204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b951820-a6aa-49c1-94ed-5b2f9648d600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.672204] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b951820-a6aa-49c1-94ed-5b2f9648d600',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.940359] env[62620]: INFO networking_nsxv3.common.synchronization [req-cefb9977-e139-4cf0-85fc-4e49647a62eb req-d9590231-e121-4a50-834d-35694c976861 tempest-ServerGroupTestJSON-1579268237 tempest-ServerGroupTestJSON-1579268237-project-member] Enqueued Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGHEST for action security_group_members [ 938.941049] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGHEST for action security_group_members [ 938.941356] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17653238-10f5-4057-bb3a-0d1116cfe7f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.941477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.941545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.941809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.941960] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.943828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.943912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.944088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.944171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.944272] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17653238-10f5-4057-bb3a-0d1116cfe7f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.946294] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.174737] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b951820-a6aa-49c1-94ed-5b2f9648d600 [ 939.174982] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.175125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.175197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.175407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.175497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.175617] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b951820-a6aa-49c1-94ed-5b2f9648d600 already deleted. [ 939.175723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b951820-a6aa-49c1-94ed-5b2f9648d600" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.450470] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.450470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.450470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.450470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.450470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.450470] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.450470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.450470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.450470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.450470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.450470] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 already deleted. [ 939.450470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.450470] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.568241] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-143 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.568241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-143" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.568241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-143" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.568241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-143" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.568241] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.568241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.568241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.568769] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.569278] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.569635] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.569946] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.570359] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.570606] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.570842] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.573017] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.573017] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.593019] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.593019] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 939.593019] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.593019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-143" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.593019] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.593019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.593019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.593019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.593019] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1edb8f37-0f69-4fa7-9649-7a07dad18ee3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.957406] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.957406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.957406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.957406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.957406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.957406] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 939.985447] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.985447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.985447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.985447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.985447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.993920] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 940.095253] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.096268] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.096268] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.096268] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.096268] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.096268] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 1edb8f37-0f69-4fa7-9649-7a07dad18ee3 not found, creating... [ 940.096504] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.096961] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.096961] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.097091] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.097186] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.097525] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.097696] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.097827] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.098059] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.098207] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.098359] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 1edb8f37-0f69-4fa7-9649-7a07dad18ee3 is going to be created. [ 940.120712] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.120712] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.120712] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.120712] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.120712] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.120712] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.140093] env[62620]: INFO networking_nsxv3.common.synchronization [None req-6bdba0c9-bab2-4016-aa3a-d782e9b1bfdc tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 940.140093] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 940.140215] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.140272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.140319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.140956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.140956] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.202055] env[62620]: INFO networking_nsxv3.common.synchronization [req-355ab114-cc8f-4f20-829e-7f29011ee8ef req-7457123a-a412-41fe-bea9-9458ac903840 tempest-VolumesAdminNegativeTest-1197893955 tempest-VolumesAdminNegativeTest-1197893955-project-member] Enqueued Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGHEST for action security_group_members [ 940.202867] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGHEST for action security_group_members [ 940.202867] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.203041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.203080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.203312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.203464] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.203564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.203628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.203776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.203856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.203946] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b8397bc-7c95-4fde-85f0-d0f8be61ee49',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.229335] env[62620]: INFO networking_nsxv3.common.synchronization [None req-296a167c-1018-4d2f-b30b-cd4112883bfe tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 940.229335] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 940.229436] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.229548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.611078] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-387 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.611470] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-387" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.611470] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-387" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.611745] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-387" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.612199] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.612199] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.612387] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.612631] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.612700] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.613021] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.613021] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.613128] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.613236] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.613351] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.613462] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.613606] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.634681] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.634681] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 940.634681] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.634681] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-387" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.634681] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-383a9402-570b-4677-b3fd-f0854a5bb40f taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.634681] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-383a9402-570b-4677-b3fd-f0854a5bb40f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.634681] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-383a9402-570b-4677-b3fd-f0854a5bb40f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.634681] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-383a9402-570b-4677-b3fd-f0854a5bb40f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.634681] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383a9402-570b-4677-b3fd-f0854a5bb40f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.663956] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.663956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.663956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.663956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.663956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.663956] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 already deleted. [ 940.663956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.663956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.663956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.663956] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.709256] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.709256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.709256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.709256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.709256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.709256] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.709256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.709256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.709256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.709256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.709256] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 already deleted. [ 940.709256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.075247] env[62620]: INFO networking_nsxv3.common.synchronization [req-cefb9977-e139-4cf0-85fc-4e49647a62eb req-fc650218-ab0e-4ffd-84a2-4962ff16cfa8 service nova] Enqueued Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGHEST for action security_group_rules [ 941.075247] env[62620]: INFO networking_nsxv3.common.synchronization [req-cefb9977-e139-4cf0-85fc-4e49647a62eb req-fc650218-ab0e-4ffd-84a2-4962ff16cfa8 service nova] Enqueued Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGHEST for action security_group_members [ 941.075247] env[62620]: INFO networking_nsxv3.common.synchronization [req-cefb9977-e139-4cf0-85fc-4e49647a62eb req-fc650218-ab0e-4ffd-84a2-4962ff16cfa8 service nova] Enqueued Resource ID: 1edb8f37-0f69-4fa7-9649-7a07dad18ee3 with Priority: HIGHEST for action port [ 941.075247] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGHEST for action security_group_rules [ 941.075247] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGHEST for action security_group_members [ 941.075247] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1edb8f37-0f69-4fa7-9649-7a07dad18ee3 with Priority: HIGHEST for action port [ 941.075986] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17653238-10f5-4057-bb3a-0d1116cfe7f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.076298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.076612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.077024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.077243] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17653238-10f5-4057-bb3a-0d1116cfe7f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.080253] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17653238-10f5-4057-bb3a-0d1116cfe7f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.080829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.080829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.081542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.081759] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.082306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.082829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.083207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.083524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.084309] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17653238-10f5-4057-bb3a-0d1116cfe7f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.084954] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.085556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.085958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.086327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.086797] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1edb8f37-0f69-4fa7-9649-7a07dad18ee3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.136975] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.137364] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.137583] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.137961] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.138189] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.138412] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 383a9402-570b-4677-b3fd-f0854a5bb40f not found, creating... [ 941.138756] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.139083] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.139239] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.139530] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.139855] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.140081] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.140322] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.140510] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.140785] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.140992] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.141225] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 383a9402-570b-4677-b3fd-f0854a5bb40f is going to be created. [ 941.159765] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.160294] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.160594] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.161034] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.161361] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.161810] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-383a9402-570b-4677-b3fd-f0854a5bb40f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.184447] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.185826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.185826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.185826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.185826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.185826] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 already deleted. [ 941.185826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.589206] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17653238-10f5-4057-bb3a-0d1116cfe7f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.590469] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17653238-10f5-4057-bb3a-0d1116cfe7f0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.590591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.590810] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1edb8f37-0f69-4fa7-9649-7a07dad18ee3 with status ACTIVE [ 941.591045] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.591229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.591305] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.591562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.591722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.591949] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.592107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.592217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.592431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.592560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.592793] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.592984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.593092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.593408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.593529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.593663] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1edb8f37-0f69-4fa7-9649-7a07dad18ee3 is going to be updated. [ 941.614306] env[62620]: INFO networking_nsxv3.common.synchronization [None req-536864bd-e8be-42a8-b561-2a64cc4ec6b4 None None] Enqueued Resource ID: 2f579998-0f7a-4222-a689-59705bd4fd42 with Priority: HIGHEST for action port [ 941.615857] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.616659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.616778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.617334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.617334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.617334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1edb8f37-0f69-4fa7-9649-7a07dad18ee3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.617680] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f579998-0f7a-4222-a689-59705bd4fd42 with Priority: HIGHEST for action port [ 941.618351] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f579998-0f7a-4222-a689-59705bd4fd42 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.618469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f579998-0f7a-4222-a689-59705bd4fd42" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.618537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f579998-0f7a-4222-a689-59705bd4fd42" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.618814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f579998-0f7a-4222-a689-59705bd4fd42" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.619391] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f579998-0f7a-4222-a689-59705bd4fd42',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.911144] env[62620]: INFO networking_nsxv3.common.synchronization [req-355ab114-cc8f-4f20-829e-7f29011ee8ef req-498ef9c4-9ce0-4ff9-9031-9ab8e85e2ba7 service nova] Enqueued Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGHEST for action security_group_rules [ 941.911369] env[62620]: INFO networking_nsxv3.common.synchronization [req-355ab114-cc8f-4f20-829e-7f29011ee8ef req-498ef9c4-9ce0-4ff9-9031-9ab8e85e2ba7 service nova] Enqueued Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGHEST for action security_group_members [ 941.911512] env[62620]: INFO networking_nsxv3.common.synchronization [req-355ab114-cc8f-4f20-829e-7f29011ee8ef req-498ef9c4-9ce0-4ff9-9031-9ab8e85e2ba7 service nova] Enqueued Resource ID: 383a9402-570b-4677-b3fd-f0854a5bb40f with Priority: HIGHEST for action port [ 941.912050] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGHEST for action security_group_rules [ 941.912519] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGHEST for action security_group_members [ 941.912519] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 383a9402-570b-4677-b3fd-f0854a5bb40f with Priority: HIGHEST for action port [ 941.912720] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.913815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.914186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.914397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.915112] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b8397bc-7c95-4fde-85f0-d0f8be61ee49',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.917182] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.918461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.918461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.918461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.918461] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.918461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.918461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.918461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.918461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.919054] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b8397bc-7c95-4fde-85f0-d0f8be61ee49',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.919349] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-383a9402-570b-4677-b3fd-f0854a5bb40f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.919422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-383a9402-570b-4677-b3fd-f0854a5bb40f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.919459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-383a9402-570b-4677-b3fd-f0854a5bb40f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.919594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-383a9402-570b-4677-b3fd-f0854a5bb40f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.919667] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383a9402-570b-4677-b3fd-f0854a5bb40f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.009055] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 942.009325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.095717] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17653238-10f5-4057-bb3a-0d1116cfe7f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.122038] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f579998-0f7a-4222-a689-59705bd4fd42 [ 942.122228] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.122364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.122430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.122639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.122732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.122837] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f579998-0f7a-4222-a689-59705bd4fd42 already deleted. [ 942.122954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f579998-0f7a-4222-a689-59705bd4fd42" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.422727] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b8397bc-7c95-4fde-85f0-d0f8be61ee49',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.423295] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.423431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.423611] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 383a9402-570b-4677-b3fd-f0854a5bb40f with status ACTIVE [ 942.423772] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.423885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.424565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.424565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.424565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.424565] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.424565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.424565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.424868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.425023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.425344] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.425468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.425563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.425988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.425988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.425988] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 383a9402-570b-4677-b3fd-f0854a5bb40f is going to be updated. [ 942.446260] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.446403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.446473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.446679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.446939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.446984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-383a9402-570b-4677-b3fd-f0854a5bb40f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.598048] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.598143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.598191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.599227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.599227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.599227] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 is going to be created. [ 942.634552] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.634552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.634552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.634552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.634552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.642755] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 in Status: UNINITIALIZED for 2s [ 942.805807] env[62620]: INFO networking_nsxv3.common.synchronization [req-2560e1f7-3420-4399-9633-1d0a91e9dd9d req-c8293146-4efc-4f86-878d-0edc8ff65d4f tempest-ServersV294TestFqdnHostnames-171705297 tempest-ServersV294TestFqdnHostnames-171705297-project-member] Enqueued Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_members [ 942.806388] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_members [ 942.807285] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.807285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.807285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.807285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.807566] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.807566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.807566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.807909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.807909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.807909] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.928155] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b8397bc-7c95-4fde-85f0-d0f8be61ee49',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.261785] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.262024] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-292" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.263047] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-292" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.263047] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-292" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.263249] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.263463] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.263612] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.263956] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.264180] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.266565] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.266565] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.266565] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.266565] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.266565] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.266565] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.266565] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.295956] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.296204] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 943.296310] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.296496] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-292" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.296819] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-39451f1f-3666-45ef-8833-8b223f0961e5 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.297033] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-39451f1f-3666-45ef-8833-8b223f0961e5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.297180] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-39451f1f-3666-45ef-8833-8b223f0961e5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.297500] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-39451f1f-3666-45ef-8833-8b223f0961e5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.297652] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39451f1f-3666-45ef-8833-8b223f0961e5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.311366] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.311482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.311521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.311943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.312103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.312587] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.312727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.312845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.313559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.313698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.313824] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a already deleted. [ 943.313937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.430493] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.431955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.431955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.431955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.431955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.431955] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 is going to be created. [ 943.432937] env[62620]: INFO networking_nsxv3.common.synchronization [req-573c58fd-08ae-43be-961d-aafd92d16d8a req-8047b12d-6a0a-45ef-8ce0-9d24874524cc tempest-ServerDiagnosticsTest-533968786 tempest-ServerDiagnosticsTest-533968786-project-member] Enqueued Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGHEST for action security_group_members [ 943.434085] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGHEST for action security_group_members [ 943.434922] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9631f352-d470-4c89-91c3-5135b61e37bb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.435138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.435385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.435639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.435848] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.436019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.436173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.436382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.436512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.436644] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9631f352-d470-4c89-91c3-5135b61e37bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.455587] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.455587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.455753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.456080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.456334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.464977] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 in Status: UNINITIALIZED for 2s [ 943.804019] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.804019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.804019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.804019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.804019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.804019] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 39451f1f-3666-45ef-8833-8b223f0961e5 not found, creating... [ 943.804019] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.804019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.804019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.804019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.804019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.804956] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.804956] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.804956] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.809870] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.809870] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.809870] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 39451f1f-3666-45ef-8833-8b223f0961e5 is going to be created. [ 943.828229] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.828559] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.828639] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.829677] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.829677] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.829677] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-39451f1f-3666-45ef-8833-8b223f0961e5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.938562] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.938749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.938826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.939077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.939185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.939396] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.939500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.939564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.939739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.939812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.939889] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9631f352-d470-4c89-91c3-5135b61e37bb is going to be updated. [ 943.973387] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.973565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.973640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.973807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.973951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.982935] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9631f352-d470-4c89-91c3-5135b61e37bb in Status: IN_PROGRESS for 2s [ 944.633024] env[62620]: INFO networking_nsxv3.common.synchronization [req-2560e1f7-3420-4399-9633-1d0a91e9dd9d req-6878bf39-7547-4edc-a82e-7850e4292f6d service nova] Enqueued Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_rules [ 944.633789] env[62620]: INFO networking_nsxv3.common.synchronization [req-2560e1f7-3420-4399-9633-1d0a91e9dd9d req-6878bf39-7547-4edc-a82e-7850e4292f6d service nova] Enqueued Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_members [ 944.633789] env[62620]: INFO networking_nsxv3.common.synchronization [req-2560e1f7-3420-4399-9633-1d0a91e9dd9d req-6878bf39-7547-4edc-a82e-7850e4292f6d service nova] Enqueued Resource ID: 39451f1f-3666-45ef-8833-8b223f0961e5 with Priority: HIGHEST for action port [ 944.634151] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_rules [ 944.634249] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_members [ 944.634442] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39451f1f-3666-45ef-8833-8b223f0961e5 with Priority: HIGHEST for action port [ 944.634730] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.634889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.634977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.635238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.635344] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.636264] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.636427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.636547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.636717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.640024] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.640024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.640024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.640024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.640024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.640024] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.640024] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-39451f1f-3666-45ef-8833-8b223f0961e5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.640024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39451f1f-3666-45ef-8833-8b223f0961e5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.640024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39451f1f-3666-45ef-8833-8b223f0961e5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.640024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39451f1f-3666-45ef-8833-8b223f0961e5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.640024] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39451f1f-3666-45ef-8833-8b223f0961e5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.652083] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 in Status: SUCCESS [ 944.652353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.653787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.654024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.654221] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.654337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.654406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.655190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.655355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.655526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.655683] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17653238-10f5-4057-bb3a-0d1116cfe7f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.139993] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.140306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.142031] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.142909] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39451f1f-3666-45ef-8833-8b223f0961e5 with status ACTIVE [ 945.143131] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.143252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.143324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.143543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.143677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.143808] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.143907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.144041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.144137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.144213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.144392] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.144486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.144549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.144715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.145339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.145339] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39451f1f-3666-45ef-8833-8b223f0961e5 is going to be updated. [ 945.160035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17653238-10f5-4057-bb3a-0d1116cfe7f0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.160035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.160035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.160760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.160760] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.160760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.160760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.160760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.160760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.161161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.161161] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17653238-10f5-4057-bb3a-0d1116cfe7f0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.161161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.161348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.161348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.161457] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.161536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.161599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.161759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.161842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.161907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.161982] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17653238-10f5-4057-bb3a-0d1116cfe7f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.165479] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.165608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.165746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.165905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.166048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.166203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39451f1f-3666-45ef-8833-8b223f0961e5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.405388] env[62620]: INFO networking_nsxv3.common.synchronization [req-25fab27d-0d4e-4e58-9afe-3b40ddedf903 req-e28da219-5ac1-4958-9631-beec7beea29e tempest-ServerActionsTestOtherB-764568701 tempest-ServerActionsTestOtherB-764568701-project-member] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 945.406088] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 945.406433] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.406557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.406625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.406881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.407070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.407191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.407248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.407387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.407479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.407624] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.474012] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 in Status: SUCCESS [ 945.474973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.474973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.475322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.475493] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.475703] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.475812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.476077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.478553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.478683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.478799] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b8397bc-7c95-4fde-85f0-d0f8be61ee49',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.647474] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.664303] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17653238-10f5-4057-bb3a-0d1116cfe7f0: rpc.has_security_group_logging(os_id): False [ 945.682763] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.682917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.683173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.683272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.683341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.683585] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.683652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.683719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.683877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.683955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.684147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.684245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.684592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.684734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.684823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.685069] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.685359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.685446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.685687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.685687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.685798] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 is going to be created. [ 945.739317] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.739559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.739559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.739724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.739901] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.749781] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 in Status: IN_PROGRESS for 2s [ 945.892017] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.892017] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.892017] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.892017] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.892017] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.892017] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.892539] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.892895] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.893196] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.893568] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.893830] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.894086] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.894347] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.894587] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.894883] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.895182] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.911774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.911774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.911774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.911774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.911774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.911774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.911774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.911774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.911774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.911774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.911774] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 already deleted. [ 945.911774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.915461] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.915461] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.915461] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.916116] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.916629] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-332cfd7e-9934-429a-bc74-275d48f07fdb taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.916996] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-332cfd7e-9934-429a-bc74-275d48f07fdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.917294] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-332cfd7e-9934-429a-bc74-275d48f07fdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.917703] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-332cfd7e-9934-429a-bc74-275d48f07fdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.918029] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('332cfd7e-9934-429a-bc74-275d48f07fdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.984147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.984147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.984147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.984147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.984147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.984721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.984721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.984721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.984721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.984721] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b8397bc-7c95-4fde-85f0-d0f8be61ee49',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.993058] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9631f352-d470-4c89-91c3-5135b61e37bb in Status: SUCCESS [ 945.993400] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9631f352-d470-4c89-91c3-5135b61e37bb deletion is rescheduled due to dependency. [ 945.993400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.150646] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.151040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.151040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.151152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.151252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.151331] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a is going to be created. [ 946.172587] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.172738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.172797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.173314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.173314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.182450] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a in Status: UNINITIALIZED for 2s [ 946.421084] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.421267] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.422360] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.422360] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.422360] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.422360] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 332cfd7e-9934-429a-bc74-275d48f07fdb not found, creating... [ 946.422360] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.422631] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.422670] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.422912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.423133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.423363] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.423523] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.423759] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.423888] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.423998] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.424151] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 332cfd7e-9934-429a-bc74-275d48f07fdb is going to be created. [ 946.442833] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.442912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.442979] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.443254] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.443486] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.443714] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-332cfd7e-9934-429a-bc74-275d48f07fdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.486475] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b8397bc-7c95-4fde-85f0-d0f8be61ee49: rpc.has_security_group_logging(os_id): False [ 946.503256] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.503414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.503538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.503678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.504141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.504141] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.504230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.504230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.504369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.504447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.504631] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.505130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.505130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.505244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.505716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.505812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.505908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.506352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.506352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.506352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.506352] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 is going to be created. [ 946.597220] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.597380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.597450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.597654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.597836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.613284] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 in Status: IN_PROGRESS for 2s [ 947.241243] env[62620]: INFO networking_nsxv3.common.synchronization [req-25fab27d-0d4e-4e58-9afe-3b40ddedf903 req-d1ecbad7-f6f3-45a1-be86-2c106cde46b1 service nova] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 947.241538] env[62620]: INFO networking_nsxv3.common.synchronization [req-25fab27d-0d4e-4e58-9afe-3b40ddedf903 req-d1ecbad7-f6f3-45a1-be86-2c106cde46b1 service nova] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 947.241902] env[62620]: INFO networking_nsxv3.common.synchronization [req-25fab27d-0d4e-4e58-9afe-3b40ddedf903 req-d1ecbad7-f6f3-45a1-be86-2c106cde46b1 service nova] Enqueued Resource ID: 332cfd7e-9934-429a-bc74-275d48f07fdb with Priority: HIGHEST for action port [ 947.242528] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 947.242755] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 947.242932] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332cfd7e-9934-429a-bc74-275d48f07fdb with Priority: HIGHEST for action port [ 947.243313] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.243515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.243597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.244828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.244828] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.245537] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.245632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.249100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.249100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.249100] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.249100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.249100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.249100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.249100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.249100] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.249100] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-332cfd7e-9934-429a-bc74-275d48f07fdb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.249100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-332cfd7e-9934-429a-bc74-275d48f07fdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.249100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-332cfd7e-9934-429a-bc74-275d48f07fdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.249100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-332cfd7e-9934-429a-bc74-275d48f07fdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.249100] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('332cfd7e-9934-429a-bc74-275d48f07fdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.751488] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.751665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.752330] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.753284] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 332cfd7e-9934-429a-bc74-275d48f07fdb with status ACTIVE [ 947.753482] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.753631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.753715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.753963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.754113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.754361] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.754493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.754591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.754805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.754911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.755154] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.755304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.755379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.755575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.755672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.755766] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 332cfd7e-9934-429a-bc74-275d48f07fdb is going to be updated. [ 947.763702] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 in Status: SUCCESS [ 947.763942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.779149] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.779149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.779149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.779149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.779149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.779149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-332cfd7e-9934-429a-bc74-275d48f07fdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.193979] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a in Status: SUCCESS [ 948.196018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.196018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.196018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.196018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.196018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.196018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.196018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.196018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.196018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.196018] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.257881] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.627109] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 in Status: SUCCESS [ 948.627348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.699660] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.761188] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.761344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.761428] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.761696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.761814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.761943] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be created. [ 948.785942] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.786104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.786175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.786400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.786563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.796190] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: UNINITIALIZED for 2s [ 949.206391] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4bf8496-ff71-4fa9-864f-e73e2d343c8a: rpc.has_security_group_logging(os_id): False [ 949.322977] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.322977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.322977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.323545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.323545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.323610] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.323667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.323724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.323929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.324010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.324075] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a is going to be created. [ 949.426531] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.426531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.426531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.426531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.426531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.438561] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a in Status: IN_PROGRESS for 2s [ 950.805602] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 950.805890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.806683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.806683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.806683] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.806683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 950.807053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.807053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.807053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.807239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.807239] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.053269] env[62620]: INFO networking_nsxv3.common.synchronization [req-acda6638-c9cf-460e-9dc1-b5ba7c2eb229 req-ea33c0f7-06a8-44fd-9585-7a701e2122c5 tempest-ServerRescueTestJSON-1890721172 tempest-ServerRescueTestJSON-1890721172-project-member] Enqueued Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 951.053269] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 951.053269] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.053718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.053718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.053876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.054046] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.054113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.054222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.054383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.054558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.054612] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.309421] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.455134] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a in Status: SUCCESS [ 951.455435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.558175] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.756632] env[62620]: INFO networking_nsxv3.common.synchronization [req-d8337a53-c167-4f0e-bf22-c90bfb4511f0 req-8cf54617-ac71-42ca-a435-d1018ce6cf69 tempest-ServerGroupTestJSON-1579268237 tempest-ServerGroupTestJSON-1579268237-project-member] Enqueued Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGHEST for action security_group_members [ 951.757335] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGHEST for action security_group_members [ 951.757662] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-17653238-10f5-4057-bb3a-0d1116cfe7f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.757848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.758080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.758260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.758324] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.762026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.762026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.762026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.762026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.762026] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17653238-10f5-4057-bb3a-0d1116cfe7f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.811805] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1536c72e-7b4e-46f0-a419-8f3b5002e371: rpc.has_security_group_logging(os_id): False [ 951.829735] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.829876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.829982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.830181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.830270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.830504] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.830609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.830665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.830813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.830891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.830973] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be created. [ 951.889301] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.889569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.889569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.889965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.890286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.904949] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 952.060988] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.262683] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.262885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.262962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.263208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.263328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.263539] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.264051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.264051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.264051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.264051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.264051] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 is going to be updated. [ 952.291483] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.291660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.291731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.291942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.292401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.303322] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 in Status: IN_PROGRESS for 2s [ 952.563550] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.563732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.563803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.564029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.564205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.564309] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 is going to be updated. [ 952.598491] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.598649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.598730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.598941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.599096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.609310] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: IN_PROGRESS for 2s [ 953.916427] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 953.916910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.312900] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 in Status: SUCCESS [ 954.313112] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 deletion is rescheduled due to dependency. [ 954.313246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.620297] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: SUCCESS [ 954.620427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.905800] env[62620]: INFO networking_nsxv3.common.synchronization [req-cac29609-8498-41d9-8f38-b47ef29db5d0 req-99d2b7e3-137a-40a2-a444-3c07aed9a783 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_members [ 954.906514] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_members [ 954.906959] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-fddb815e-1994-464a-8450-9db44691d6ac taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.908392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.908392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.908665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.909052] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.910383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.910383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.910383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.910383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.910383] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.344509] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.344854] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.344854] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.345157] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.345419] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.345581] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.345701] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.346301] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.346461] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.346676] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.346798] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.346916] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.347044] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.347161] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.347272] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.347410] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.366302] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.366461] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 955.366603] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.366775] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.367113] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.367297] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.367422] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.367730] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.367873] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3f3405-39a4-4c22-9c26-bdd0ab342c29',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.416112] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.416112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.416112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.416333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.417027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.417027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.417027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.417027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.417291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.417291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.417291] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fddb815e-1994-464a-8450-9db44691d6ac already deleted. [ 955.417396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.831356] env[62620]: INFO networking_nsxv3.common.synchronization [req-a02867fa-0d21-41cc-97cb-36aa98a7d386 req-4f17b3b4-6614-492c-8bbb-b7bf960bfe7b tempest-VolumesAdminNegativeTest-1197893955 tempest-VolumesAdminNegativeTest-1197893955-project-member] Enqueued Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGHEST for action security_group_members [ 955.831909] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGHEST for action security_group_members [ 955.833316] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.833447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.833517] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.833719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.833875] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.833978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.834055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.834205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.834290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.834384] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b8397bc-7c95-4fde-85f0-d0f8be61ee49',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.873696] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.873696] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.873898] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.874038] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.874202] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.874437] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 4c3f3405-39a4-4c22-9c26-bdd0ab342c29 not found, creating... [ 955.874629] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.874800] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.874920] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.875169] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.875300] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.875580] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.875889] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.875889] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.876078] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.876215] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.876359] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 4c3f3405-39a4-4c22-9c26-bdd0ab342c29 is going to be created. [ 955.895427] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.895707] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.895879] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.896238] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.896536] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.896811] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.336559] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.336720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.336795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.337040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.337168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.337373] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.337476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.337545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.337708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.337789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.337906] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 is going to be updated. [ 956.363893] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.364245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.364245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.364401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.364535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.372241] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 in Status: IN_PROGRESS for 2s [ 956.670727] env[62620]: INFO networking_nsxv3.common.synchronization [req-cac29609-8498-41d9-8f38-b47ef29db5d0 req-f6bb8f19-124f-4ce7-8937-82a17b34d1e9 service nova] Enqueued Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_rules [ 956.671584] env[62620]: INFO networking_nsxv3.common.synchronization [req-cac29609-8498-41d9-8f38-b47ef29db5d0 req-f6bb8f19-124f-4ce7-8937-82a17b34d1e9 service nova] Enqueued Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_members [ 956.671584] env[62620]: INFO networking_nsxv3.common.synchronization [req-cac29609-8498-41d9-8f38-b47ef29db5d0 req-f6bb8f19-124f-4ce7-8937-82a17b34d1e9 service nova] Enqueued Resource ID: 4c3f3405-39a4-4c22-9c26-bdd0ab342c29 with Priority: HIGHEST for action port [ 956.671584] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_rules [ 956.671584] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_members [ 956.671584] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3f3405-39a4-4c22-9c26-bdd0ab342c29 with Priority: HIGHEST for action port [ 956.673164] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fddb815e-1994-464a-8450-9db44691d6ac taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.673164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.673164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.673164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.673164] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.675621] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-fddb815e-1994-464a-8450-9db44691d6ac taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.676761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.676837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.677159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.677225] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.677463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.677463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.677553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.677601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.677677] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.678486] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.678593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.678658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.678806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.678884] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3f3405-39a4-4c22-9c26-bdd0ab342c29',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.182211] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-fddb815e-1994-464a-8450-9db44691d6ac taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.182344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.182534] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.183390] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c3f3405-39a4-4c22-9c26-bdd0ab342c29 with status ACTIVE [ 957.183639] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.183774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.183859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.184090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.184184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.184349] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.184444] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.184508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.184666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.184780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.185612] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.186408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.186408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.186408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.186408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.186408] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c3f3405-39a4-4c22-9c26-bdd0ab342c29 is going to be updated. [ 957.207199] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.207395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.207528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.207759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.207933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.208138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c3f3405-39a4-4c22-9c26-bdd0ab342c29" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.688654] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.190691] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.190894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.190945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.191177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.191273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.191375] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fddb815e-1994-464a-8450-9db44691d6ac is going to be created. [ 958.221357] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.221562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.221562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.221844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.222027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.231468] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fddb815e-1994-464a-8450-9db44691d6ac in Status: UNINITIALIZED for 2s [ 958.382135] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 in Status: SUCCESS [ 958.382353] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 deletion is rescheduled due to dependency. [ 958.382529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.240074] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fddb815e-1994-464a-8450-9db44691d6ac in Status: SUCCESS [ 960.240304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.240466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.240682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.240901] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.241151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.241151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.241300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.241381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.241470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.241561] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.743816] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.247267] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fddb815e-1994-464a-8450-9db44691d6ac: rpc.has_security_group_logging(os_id): False [ 961.267022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.267022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.267022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.267022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.267022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.267022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.267022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.267022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.267022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.267022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.267022] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fddb815e-1994-464a-8450-9db44691d6ac is going to be created. [ 961.325097] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.325097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.325097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.325097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.325097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.343077] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fddb815e-1994-464a-8450-9db44691d6ac in Status: IN_PROGRESS for 2s [ 961.672602] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 961.672721] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 961.753152] env[62620]: INFO networking_nsxv3.common.synchronization [req-9f5bcb25-ae27-4738-a9e0-f350bba5a060 req-894b3b74-bded-4184-a6a1-3832e8c98b68 tempest-ListImageFiltersTestJSON-306267884 tempest-ListImageFiltersTestJSON-306267884-project-member] Enqueued Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 961.753693] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c72dcb51-694a-46ed-b921-12a44f522163 with Priority: HIGHEST for action security_group_members [ 961.754010] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-c72dcb51-694a-46ed-b921-12a44f522163 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.754761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.754761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.754761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.754761] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.754761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.754761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.755334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.755451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.755569] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c72dcb51-694a-46ed-b921-12a44f522163',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.886425] env[62620]: INFO networking_nsxv3.common.synchronization [None req-c2cd6475-76a3-4f75-90c9-d2853ee402f4 None None] Enqueued Resource ID: 736a8146-c5bf-4dfd-80e9-c337451063ed with Priority: HIGHEST for action port [ 961.886883] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 736a8146-c5bf-4dfd-80e9-c337451063ed with Priority: HIGHEST for action port [ 961.888013] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-736a8146-c5bf-4dfd-80e9-c337451063ed taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.889253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-736a8146-c5bf-4dfd-80e9-c337451063ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.889253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-736a8146-c5bf-4dfd-80e9-c337451063ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.889253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-736a8146-c5bf-4dfd-80e9-c337451063ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.889253] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('736a8146-c5bf-4dfd-80e9-c337451063ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.258509] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.258831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.258831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.258978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.278462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.278869] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.279083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.279210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.279577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.279751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.279927] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c72dcb51-694a-46ed-b921-12a44f522163 is going to be updated. [ 962.309796] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.309942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.310020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.310248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.310405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.326112] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: IN_PROGRESS for 2s [ 962.393693] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 736a8146-c5bf-4dfd-80e9-c337451063ed [ 962.393853] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.393990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.394077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.394290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.394382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.394479] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:736a8146-c5bf-4dfd-80e9-c337451063ed already deleted. [ 962.394563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-736a8146-c5bf-4dfd-80e9-c337451063ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.355295] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fddb815e-1994-464a-8450-9db44691d6ac in Status: SUCCESS [ 963.355637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.836455] env[62620]: INFO networking_nsxv3.common.synchronization [None req-368ebea1-0b38-4753-8df2-4e142478fa64 None None] Enqueued Resource ID: 82ea433f-80d3-429f-816b-78c27717e5db with Priority: HIGHEST for action port [ 963.837171] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ea433f-80d3-429f-816b-78c27717e5db with Priority: HIGHEST for action port [ 963.839570] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-82ea433f-80d3-429f-816b-78c27717e5db taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.839570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82ea433f-80d3-429f-816b-78c27717e5db" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.839570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82ea433f-80d3-429f-816b-78c27717e5db" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.839867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82ea433f-80d3-429f-816b-78c27717e5db" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.839968] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82ea433f-80d3-429f-816b-78c27717e5db',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.336162] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c72dcb51-694a-46ed-b921-12a44f522163 in Status: SUCCESS [ 964.336162] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c72dcb51-694a-46ed-b921-12a44f522163 deletion is rescheduled due to dependency. [ 964.336331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c72dcb51-694a-46ed-b921-12a44f522163" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.338015] env[62620]: INFO networking_nsxv3.common.synchronization [None req-f663ac91-df33-4d88-b7dd-13241882a4e7 None None] Enqueued Resource ID: e85fdc1b-d94b-4280-a73f-3c8abd93e9ef with Priority: HIGHEST for action port [ 964.339246] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e85fdc1b-d94b-4280-a73f-3c8abd93e9ef with Priority: HIGHEST for action port [ 964.339578] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-e85fdc1b-d94b-4280-a73f-3c8abd93e9ef taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.339687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e85fdc1b-d94b-4280-a73f-3c8abd93e9ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.339752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e85fdc1b-d94b-4280-a73f-3c8abd93e9ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.340228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e85fdc1b-d94b-4280-a73f-3c8abd93e9ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.340307] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e85fdc1b-d94b-4280-a73f-3c8abd93e9ef',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.342141] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82ea433f-80d3-429f-816b-78c27717e5db [ 964.342308] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.342412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.342513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.342636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.342715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.342812] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82ea433f-80d3-429f-816b-78c27717e5db already deleted. [ 964.342905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82ea433f-80d3-429f-816b-78c27717e5db" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.843191] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e85fdc1b-d94b-4280-a73f-3c8abd93e9ef [ 964.843442] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.843558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.843625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.843863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.843985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.844066] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e85fdc1b-d94b-4280-a73f-3c8abd93e9ef already deleted. [ 964.844151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e85fdc1b-d94b-4280-a73f-3c8abd93e9ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.062826] env[62620]: INFO networking_nsxv3.common.synchronization [req-6edb8568-a4fc-4702-a1c2-ebf3359a74b9 req-ef0d3a46-2cbc-4709-8923-efca6903c5ae tempest-ServersWithSpecificFlavorTestJSON-1227304686 tempest-ServersWithSpecificFlavorTestJSON-1227304686-project-member] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 966.063373] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 966.063673] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.063789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.063854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.064811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.065019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.065120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.069018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.069018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.069018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.069018] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.377142] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-771 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.377142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-771" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.377142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-771" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.377142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-771" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.377142] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.377142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.377142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.377142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.377142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.377142] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.377142] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.377908] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.378206] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.378419] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.378610] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.378822] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.402011] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.402011] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.402011] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.402011] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-771" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.402011] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-43ceb60f-795b-49ef-b06d-892b278ac067 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.402011] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-43ceb60f-795b-49ef-b06d-892b278ac067" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.402011] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-43ceb60f-795b-49ef-b06d-892b278ac067" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.402011] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-43ceb60f-795b-49ef-b06d-892b278ac067" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.402011] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43ceb60f-795b-49ef-b06d-892b278ac067',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.500623] env[62620]: INFO networking_nsxv3.common.synchronization [None req-2ecca56b-da66-4945-a639-00f28fae6879 None None] Enqueued Resource ID: 875fea6a-e758-4a8f-b1ea-df1ec889cf30 with Priority: HIGHEST for action port [ 966.500875] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875fea6a-e758-4a8f-b1ea-df1ec889cf30 with Priority: HIGHEST for action port [ 966.501436] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-875fea6a-e758-4a8f-b1ea-df1ec889cf30 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.501554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-875fea6a-e758-4a8f-b1ea-df1ec889cf30" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.501621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-875fea6a-e758-4a8f-b1ea-df1ec889cf30" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.501869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-875fea6a-e758-4a8f-b1ea-df1ec889cf30" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.501950] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('875fea6a-e758-4a8f-b1ea-df1ec889cf30',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.567853] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.568025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.568090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.568298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.568384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.568570] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.568674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.568719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.568855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.569254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.569254] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f already deleted. [ 966.569254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.906875] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.906875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.906875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.906875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.906875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.906875] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 43ceb60f-795b-49ef-b06d-892b278ac067 not found, creating... [ 966.906875] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.906875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.906875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.906875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.906875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.908345] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.908965] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.908965] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.911380] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.911380] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.911380] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 43ceb60f-795b-49ef-b06d-892b278ac067 is going to be created. [ 966.932511] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.932511] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.932511] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.932511] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.932511] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.932511] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-43ceb60f-795b-49ef-b06d-892b278ac067" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.007497] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 875fea6a-e758-4a8f-b1ea-df1ec889cf30 [ 967.007497] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.007690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.007690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.008759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.008759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.008759] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:875fea6a-e758-4a8f-b1ea-df1ec889cf30 already deleted. [ 967.008759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-875fea6a-e758-4a8f-b1ea-df1ec889cf30" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.019812] env[62620]: INFO networking_nsxv3.common.synchronization [req-6edb8568-a4fc-4702-a1c2-ebf3359a74b9 req-05c966e2-82e1-46ba-8084-23259d543ac6 service nova] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_rules [ 968.019812] env[62620]: INFO networking_nsxv3.common.synchronization [req-6edb8568-a4fc-4702-a1c2-ebf3359a74b9 req-05c966e2-82e1-46ba-8084-23259d543ac6 service nova] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 968.019812] env[62620]: INFO networking_nsxv3.common.synchronization [req-6edb8568-a4fc-4702-a1c2-ebf3359a74b9 req-05c966e2-82e1-46ba-8084-23259d543ac6 service nova] Enqueued Resource ID: 43ceb60f-795b-49ef-b06d-892b278ac067 with Priority: HIGHEST for action port [ 968.019812] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_rules [ 968.023212] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 968.023212] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43ceb60f-795b-49ef-b06d-892b278ac067 with Priority: HIGHEST for action port [ 968.023212] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.023212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.023212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.023212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.023212] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.023965] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.024832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.024832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.024832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.024832] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.024832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.024832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.024832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.024832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.025193] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.025896] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-43ceb60f-795b-49ef-b06d-892b278ac067 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.026608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43ceb60f-795b-49ef-b06d-892b278ac067" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.026608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43ceb60f-795b-49ef-b06d-892b278ac067" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.026608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43ceb60f-795b-49ef-b06d-892b278ac067" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.026608] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43ceb60f-795b-49ef-b06d-892b278ac067',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.530580] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.531795] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.531911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.532328] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43ceb60f-795b-49ef-b06d-892b278ac067 with status ACTIVE [ 968.532328] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.532508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.532508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.533601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.533601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.533601] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.533601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.533601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.533601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.533601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.533601] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.533601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.534061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.534061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.534061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.534061] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43ceb60f-795b-49ef-b06d-892b278ac067 is going to be updated. [ 968.557675] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.557675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.557675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.561278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.561433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.561594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43ceb60f-795b-49ef-b06d-892b278ac067" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.040532] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.542595] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.542777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.542849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.543149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.543260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.543363] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f is going to be created. [ 969.564755] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.564909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.564995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.565211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.565369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.575099] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: UNINITIALIZED for 2s [ 970.458472] env[62620]: INFO networking_nsxv3.common.synchronization [req-07611db3-75d5-4d58-891f-dda53ab7227d req-7f67261b-f86c-4022-8095-947d80eb677f tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 970.458472] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 970.458779] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.458843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.458916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.459119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.459273] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.459377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.459435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.459759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.459759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.459759] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.806057] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.806285] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.806416] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.806690] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.806974] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.807156] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.807280] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.807501] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.807653] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.807899] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.808044] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.808205] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.808371] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.808512] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.808637] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.808777] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.828193] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.828362] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 970.828516] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.828710] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.829037] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-fcb37279-335e-48f7-8d54-32ecee8fa761 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.829229] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-fcb37279-335e-48f7-8d54-32ecee8fa761" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.829359] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-fcb37279-335e-48f7-8d54-32ecee8fa761" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.829688] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-fcb37279-335e-48f7-8d54-32ecee8fa761" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.829844] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcb37279-335e-48f7-8d54-32ecee8fa761',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.962767] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.962918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.962965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.963227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.963318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.963522] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.963625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.963689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.963837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.963916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.964015] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be deleted. [ 970.990066] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.990197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.990267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.990467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.990562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.990656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.331978] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.332243] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.332376] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.332673] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.332840] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.333034] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port fcb37279-335e-48f7-8d54-32ecee8fa761 not found, creating... [ 971.333321] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.333488] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.333613] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.333868] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.334105] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.334414] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.334579] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.334703] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.334940] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.335103] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.335252] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: fcb37279-335e-48f7-8d54-32ecee8fa761 is going to be created. [ 971.353993] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.354287] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.354433] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.354704] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.355011] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.355259] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-fcb37279-335e-48f7-8d54-32ecee8fa761" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.584797] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: SUCCESS [ 971.585091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.585261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.585465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.585655] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.585768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.585834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.586085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.586239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.586341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.586452] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.081212] env[62620]: INFO networking_nsxv3.common.synchronization [req-07611db3-75d5-4d58-891f-dda53ab7227d req-57c92e3d-75ea-4724-b1f6-31ea9b97236c service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 972.081381] env[62620]: INFO networking_nsxv3.common.synchronization [req-07611db3-75d5-4d58-891f-dda53ab7227d req-57c92e3d-75ea-4724-b1f6-31ea9b97236c service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 972.081470] env[62620]: INFO networking_nsxv3.common.synchronization [req-07611db3-75d5-4d58-891f-dda53ab7227d req-57c92e3d-75ea-4724-b1f6-31ea9b97236c service nova] Enqueued Resource ID: fcb37279-335e-48f7-8d54-32ecee8fa761 with Priority: HIGHEST for action port [ 972.081722] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 972.081848] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 972.081950] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcb37279-335e-48f7-8d54-32ecee8fa761 with Priority: HIGHEST for action port [ 972.082585] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.082701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.082767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.083590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.083744] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.084707] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.084906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.085152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.085389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.086289] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.086289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.086289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.086289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.086289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.086289] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.087491] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcb37279-335e-48f7-8d54-32ecee8fa761 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.087596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcb37279-335e-48f7-8d54-32ecee8fa761" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.087884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcb37279-335e-48f7-8d54-32ecee8fa761" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.087927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcb37279-335e-48f7-8d54-32ecee8fa761" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.088974] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcb37279-335e-48f7-8d54-32ecee8fa761',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.089716] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.591057] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.591057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.591057] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.591913] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7bdbdc9-465d-491e-8f58-3f3aff4b421f: rpc.has_security_group_logging(os_id): False [ 972.592941] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcb37279-335e-48f7-8d54-32ecee8fa761 with status ACTIVE [ 972.593138] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.593251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.593319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.593516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.593777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.593969] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.594085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.594151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.594314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.594397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.594575] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.594668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.594730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.594868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.595643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.595643] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcb37279-335e-48f7-8d54-32ecee8fa761 is going to be updated. [ 972.612488] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.612627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.612686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.612902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.612993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.613292] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.613397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.613461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.613634] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.613711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.613792] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f is going to be created. [ 972.616845] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.616958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.617033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.617197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.617326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.617705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcb37279-335e-48f7-8d54-32ecee8fa761" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.675736] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.675910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.676035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.676263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.676442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.692308] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: IN_PROGRESS for 2s [ 973.097171] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.601846] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.602049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.602103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.602396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.602470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.602594] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be created. [ 973.626790] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.626916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.626965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.627187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.627344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.635964] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: UNINITIALIZED for 2s [ 974.706994] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: SUCCESS [ 974.707293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.646139] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 975.646427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.646630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.646900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.647139] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.647446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.647446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.647646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.647785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.647994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.648057] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.881065] env[62620]: INFO networking_nsxv3.common.synchronization [req-96685ff4-4a5a-44f8-8a49-b99ad05d7e0e req-781a836f-fb0f-4aab-956a-484ba721314d tempest-ImagesOneServerNegativeTestJSON-1314187372 tempest-ImagesOneServerNegativeTestJSON-1314187372-project-member] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 975.881695] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 975.881898] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.882070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.882138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.882340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.882545] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.882625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.882718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.882829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.882910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.883135] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.150697] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.151211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.151333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.151495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.151715] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.151824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.151859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.152456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.152456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.152456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.152456] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.152456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.152456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.152703] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.152735] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.152909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.152995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.153150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.153228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.153312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.153408] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.271480] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.271703] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.271835] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.272153] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.272948] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.273224] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.273403] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.273701] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.273911] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.274205] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.274432] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.274549] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.274706] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.274873] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.275123] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.275332] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.294857] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.295345] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 976.295651] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.295931] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.296410] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.296699] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.296876] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.297271] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.297478] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70ec01a-fb73-4c5e-9db9-88792bcf78d7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.385211] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.385409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.385462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.385681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.385774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.386077] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.386181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.386250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.386407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.386485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.386573] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be deleted. [ 976.411441] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.411592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.411664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.411975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.411975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.412069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.655948] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c995751-5151-4812-a1e5-510ea09222e0: rpc.has_security_group_logging(os_id): False [ 976.673113] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.673208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.673287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.673476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.673522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.673703] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.673823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.673936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.673990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.674104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.674277] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.674343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.674387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.674521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.674590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.675207] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.675207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.675207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.675688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.675764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.675854] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be created. [ 976.750314] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.750597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.750597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.750737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.750910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.762854] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 976.800102] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.800348] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.800481] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.800788] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.800941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.801115] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port b70ec01a-fb73-4c5e-9db9-88792bcf78d7 not found, creating... [ 976.801607] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.801607] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.801724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.801877] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.802025] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.802312] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.802482] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.802618] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.802832] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.802969] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.803152] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: b70ec01a-fb73-4c5e-9db9-88792bcf78d7 is going to be created. [ 976.839509] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.839698] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.839900] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.840180] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.840448] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.840654] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.512133] env[62620]: INFO networking_nsxv3.common.synchronization [req-96685ff4-4a5a-44f8-8a49-b99ad05d7e0e req-e6a7159b-49ce-462e-a208-c31a83fa4ed1 service nova] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_rules [ 977.512133] env[62620]: INFO networking_nsxv3.common.synchronization [req-96685ff4-4a5a-44f8-8a49-b99ad05d7e0e req-e6a7159b-49ce-462e-a208-c31a83fa4ed1 service nova] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 977.512133] env[62620]: INFO networking_nsxv3.common.synchronization [req-96685ff4-4a5a-44f8-8a49-b99ad05d7e0e req-e6a7159b-49ce-462e-a208-c31a83fa4ed1 service nova] Enqueued Resource ID: b70ec01a-fb73-4c5e-9db9-88792bcf78d7 with Priority: HIGHEST for action port [ 977.512133] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_rules [ 977.512133] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 977.512133] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70ec01a-fb73-4c5e-9db9-88792bcf78d7 with Priority: HIGHEST for action port [ 977.513163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.513455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.513724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.514037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.514224] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.516392] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.518019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.518019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.518019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.518019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.518019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.518019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.518019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.518019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.518019] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.519108] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.519463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.519642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.519883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.520071] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70ec01a-fb73-4c5e-9db9-88792bcf78d7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.016903] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.017120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.019368] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.022591] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b70ec01a-fb73-4c5e-9db9-88792bcf78d7 with status ACTIVE [ 978.022771] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.023070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.023158] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.023378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.023474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.023727] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.023930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.024071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.024283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.024378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.024601] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.024705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.025419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.025419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.025419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.025419] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b70ec01a-fb73-4c5e-9db9-88792bcf78d7 is going to be updated. [ 978.044895] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.045025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.045102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.045275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.045434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.045549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b70ec01a-fb73-4c5e-9db9-88792bcf78d7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.522034] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.778148] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 978.778333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.024424] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.024660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.024760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.025047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.025174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.025303] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be created. [ 979.050265] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.050417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.050514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.050743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.050960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.062962] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: UNINITIALIZED for 2s [ 980.328725] env[62620]: INFO networking_nsxv3.common.synchronization [req-b16a08f8-4bdd-43bf-a745-4144824f8aa2 req-e136b483-7285-4d8b-a4c1-708573dfe373 tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 980.329259] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 980.329569] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.329686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.329821] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.330016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.330175] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.330281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.330346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.330495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.330579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.330668] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.428269] env[62620]: INFO networking_nsxv3.common.synchronization [req-e74315bb-ef07-4a11-b4d2-6fa8e5f27d04 req-0c4826ee-259d-4db2-979f-9eb0595fc6b5 tempest-ServersAdminTestJSON-158660873 tempest-ServersAdminTestJSON-158660873-project-member] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 980.428269] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 980.428269] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.428269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.428269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.428269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.428269] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.428269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.428269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.428269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.432098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.432319] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.755395] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-636 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.755619] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.755737] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.756097] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.756372] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.756538] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.756662] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.756885] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.757138] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.757443] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.757585] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.757683] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.757795] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.757910] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.758033] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.758176] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.775875] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.776057] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 980.776209] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.776380] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.776648] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-5825a537-f659-4e7e-907e-e22208e06c0c taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.776810] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-5825a537-f659-4e7e-907e-e22208e06c0c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.776933] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-5825a537-f659-4e7e-907e-e22208e06c0c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.777231] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-5825a537-f659-4e7e-907e-e22208e06c0c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.777437] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5825a537-f659-4e7e-907e-e22208e06c0c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.832257] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.832379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.832471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.832650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.832741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.832980] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.833105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.833160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.833302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.833382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.833465] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 already deleted. [ 980.833537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.934933] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.072283] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 981.072524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.072690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.072916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.073142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.073272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.073335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.073485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.073565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.073650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.073739] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.279292] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.279575] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.279654] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.279994] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.280165] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.280310] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 5825a537-f659-4e7e-907e-e22208e06c0c not found, creating... [ 981.280581] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.280761] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.280874] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.281138] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.281274] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.281555] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.281713] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.281835] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.282062] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.282206] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.282349] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 5825a537-f659-4e7e-907e-e22208e06c0c is going to be created. [ 981.300362] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.300616] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.300800] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.301121] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.301390] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.301655] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-5825a537-f659-4e7e-907e-e22208e06c0c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.439269] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.580714] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.580903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.580944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.581188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.581357] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.581617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.581617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.581724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.581753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.581852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.582122] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.582173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.582226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.582369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.582507] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.582601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.582651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.582795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.582946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.583244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.583363] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.942104] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.942271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.942344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.942565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.942657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.942757] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 981.971090] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.971239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.971335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.971540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.971686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.981290] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 982.033210] env[62620]: INFO networking_nsxv3.common.synchronization [req-b16a08f8-4bdd-43bf-a745-4144824f8aa2 req-c45cb5a9-bbf6-4ad7-9dd9-8d2ce208f588 service nova] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 982.033210] env[62620]: INFO networking_nsxv3.common.synchronization [req-b16a08f8-4bdd-43bf-a745-4144824f8aa2 req-c45cb5a9-bbf6-4ad7-9dd9-8d2ce208f588 service nova] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 982.033210] env[62620]: INFO networking_nsxv3.common.synchronization [req-b16a08f8-4bdd-43bf-a745-4144824f8aa2 req-c45cb5a9-bbf6-4ad7-9dd9-8d2ce208f588 service nova] Enqueued Resource ID: 5825a537-f659-4e7e-907e-e22208e06c0c with Priority: HIGHEST for action port [ 982.033210] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 982.033876] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 982.034091] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5825a537-f659-4e7e-907e-e22208e06c0c with Priority: HIGHEST for action port [ 982.034384] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.034522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.034609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.034850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.034956] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.035881] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.035993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.036072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.036227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.037150] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.037150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.037150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.037150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.037150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.037322] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.038019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-5825a537-f659-4e7e-907e-e22208e06c0c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.038460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5825a537-f659-4e7e-907e-e22208e06c0c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.038460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5825a537-f659-4e7e-907e-e22208e06c0c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.038460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5825a537-f659-4e7e-907e-e22208e06c0c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.038460] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5825a537-f659-4e7e-907e-e22208e06c0c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.085847] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95e0473d-1c6d-4b24-a6d9-f419a29f67f5: rpc.has_security_group_logging(os_id): False [ 982.102309] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.102453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.102532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.102741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.102832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.103064] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.103204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.103242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.103385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.103559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.103746] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.103825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.103871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.104091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.104231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.104363] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.104465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.104531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.104691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.104763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.104840] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be created. [ 982.156015] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.156206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.156246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.156455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.156635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.166558] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: IN_PROGRESS for 2s [ 982.540821] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5825a537-f659-4e7e-907e-e22208e06c0c with status ACTIVE [ 982.540821] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.540821] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.541192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.542288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.542288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.542288] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.542288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.542288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.542288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.542288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.542659] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.542793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.542934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.543162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.543289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.543399] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5825a537-f659-4e7e-907e-e22208e06c0c is going to be updated. [ 982.544789] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.544933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.545198] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.565598] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.565738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.565814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.566092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.566257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.566424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5825a537-f659-4e7e-907e-e22208e06c0c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.048073] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.551926] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.552206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.552300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.552617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.552753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.552970] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be created. [ 983.574951] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.575101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.575167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.575386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.575541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.583717] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: UNINITIALIZED for 2s [ 983.990798] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 983.991050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.177424] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 984.177821] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.592753] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 985.593030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.593157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.593401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.593564] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.593688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.593757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.593907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.593987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.594087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.594179] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.097508] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.600271] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b84c6a20-87b1-462b-accd-d32f1296df07: rpc.has_security_group_logging(os_id): False [ 986.617862] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.618114] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.618246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.618568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.618723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.619119] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.619289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.619397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.619658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.619805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.619959] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be created. [ 986.674374] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.674374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.674538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.674681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.674816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.684448] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 987.038312] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 987.038312] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 987.856292] env[62620]: INFO networking_nsxv3.common.synchronization [req-401141a2-aece-4efb-b266-5ea3062df309 req-f74d890c-7100-4b55-a453-bf8d808ed0e4 tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 987.856834] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 987.857134] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.857273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.857308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.857605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.857698] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.857776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.857834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.858008] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.860128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.860241] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.247020] env[62620]: INFO networking_nsxv3.common.synchronization [req-401141a2-aece-4efb-b266-5ea3062df309 req-ef31e64b-33a6-4f21-bb01-05132516901f tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 988.247020] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 988.247020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.247020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.363710] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.363886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.363939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.364186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.383409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.383615] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.383615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.383737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.384433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.384433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.384433] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 988.405554] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.405662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.405738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.405916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.406201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.413966] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 988.642692] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-337 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.642918] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-337" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.643076] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-337" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.643460] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-337" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.643763] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.643938] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.644101] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.644353] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.644524] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.644743] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.644880] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.645026] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.645199] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.645328] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.645446] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.645604] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.663352] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.663570] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 988.663699] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.663905] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-337" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.664272] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-2277dd85-8be7-4a0e-852b-451705959e88 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.664472] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-2277dd85-8be7-4a0e-852b-451705959e88" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.664611] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-2277dd85-8be7-4a0e-852b-451705959e88" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.664955] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-2277dd85-8be7-4a0e-852b-451705959e88" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.665224] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2277dd85-8be7-4a0e-852b-451705959e88',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.695015] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 988.695296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.167595] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.167968] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.168017] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.168390] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.168588] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.168799] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 2277dd85-8be7-4a0e-852b-451705959e88 not found, creating... [ 989.169120] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.169345] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.169517] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.169782] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.169960] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.170277] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.170445] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.170568] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.170783] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.170925] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.171107] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 2277dd85-8be7-4a0e-852b-451705959e88 is going to be created. [ 989.201232] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.201555] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.201770] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.202064] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.202310] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.202539] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-2277dd85-8be7-4a0e-852b-451705959e88" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.042535] env[62620]: INFO networking_nsxv3.common.synchronization [req-401141a2-aece-4efb-b266-5ea3062df309 req-dfe72539-4aa8-4f5c-adcd-3b8f8ee9ad9b service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 990.043595] env[62620]: INFO networking_nsxv3.common.synchronization [req-401141a2-aece-4efb-b266-5ea3062df309 req-dfe72539-4aa8-4f5c-adcd-3b8f8ee9ad9b service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 990.043595] env[62620]: INFO networking_nsxv3.common.synchronization [req-401141a2-aece-4efb-b266-5ea3062df309 req-dfe72539-4aa8-4f5c-adcd-3b8f8ee9ad9b service nova] Enqueued Resource ID: 2277dd85-8be7-4a0e-852b-451705959e88 with Priority: HIGHEST for action port [ 990.046123] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 990.046123] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 990.046123] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2277dd85-8be7-4a0e-852b-451705959e88 with Priority: HIGHEST for action port [ 990.047062] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.047062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.047062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.048335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.048335] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.050922] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.050922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.050922] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2277dd85-8be7-4a0e-852b-451705959e88 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.050922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2277dd85-8be7-4a0e-852b-451705959e88" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.050922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2277dd85-8be7-4a0e-852b-451705959e88" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.050922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2277dd85-8be7-4a0e-852b-451705959e88" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.050922] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2277dd85-8be7-4a0e-852b-451705959e88',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.424082] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 990.424082] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e deletion is rescheduled due to dependency. [ 990.424082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.424082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.424888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.424888] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.424888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.424888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.425141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.425141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.425208] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.553763] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2277dd85-8be7-4a0e-852b-451705959e88 with status ACTIVE [ 990.553991] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.554209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.554272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.554475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.554566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.554746] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.554846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.554961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.555122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.555208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.555392] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.555483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.555546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.555690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.555762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.555851] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2277dd85-8be7-4a0e-852b-451705959e88 is going to be updated. [ 990.557031] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.557166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.577203] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.577404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.577464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.577677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.577814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.577976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2277dd85-8be7-4a0e-852b-451705959e88" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.880395] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.880647] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-256" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.880879] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-256" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.881414] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-256" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.881835] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.882085] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.882228] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.882524] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.882862] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.883062] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.883192] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.883320] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.883532] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.883753] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.883884] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.884064] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.901471] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.901733] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.901987] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.902248] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-256" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.902576] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-513e35e4-7ec3-4b36-82b0-b70d98706831 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.902756] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-513e35e4-7ec3-4b36-82b0-b70d98706831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.902879] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-513e35e4-7ec3-4b36-82b0-b70d98706831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.903256] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-513e35e4-7ec3-4b36-82b0-b70d98706831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.903398] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('513e35e4-7ec3-4b36-82b0-b70d98706831',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.928643] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.408070] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.408331] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.408494] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.408803] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.408921] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.409079] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 513e35e4-7ec3-4b36-82b0-b70d98706831 not found, creating... [ 991.409362] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.409524] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.409653] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.409895] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.410032] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.410350] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.410519] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.410678] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.410836] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.410977] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.411392] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 513e35e4-7ec3-4b36-82b0-b70d98706831 is going to be created. [ 991.429859] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.430281] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.430281] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.431036] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.431036] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.431169] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-513e35e4-7ec3-4b36-82b0-b70d98706831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.433288] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.935728] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.935993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.936262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.936348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.936435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.936550] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 991.978933] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.979094] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.979160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.979369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.979507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.988181] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 992.204713] env[62620]: INFO networking_nsxv3.common.synchronization [req-401141a2-aece-4efb-b266-5ea3062df309 req-641836ab-d173-4d66-8f8a-b9fd6a23ad62 service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 992.204713] env[62620]: INFO networking_nsxv3.common.synchronization [req-401141a2-aece-4efb-b266-5ea3062df309 req-641836ab-d173-4d66-8f8a-b9fd6a23ad62 service nova] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 992.204713] env[62620]: INFO networking_nsxv3.common.synchronization [req-401141a2-aece-4efb-b266-5ea3062df309 req-641836ab-d173-4d66-8f8a-b9fd6a23ad62 service nova] Enqueued Resource ID: 513e35e4-7ec3-4b36-82b0-b70d98706831 with Priority: HIGHEST for action port [ 992.204713] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_rules [ 992.204713] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 992.204713] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513e35e4-7ec3-4b36-82b0-b70d98706831 with Priority: HIGHEST for action port [ 992.205626] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.206033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.207278] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.207424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.207611] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-513e35e4-7ec3-4b36-82b0-b70d98706831 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.207739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-513e35e4-7ec3-4b36-82b0-b70d98706831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.207789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-513e35e4-7ec3-4b36-82b0-b70d98706831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.207968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-513e35e4-7ec3-4b36-82b0-b70d98706831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.208574] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('513e35e4-7ec3-4b36-82b0-b70d98706831',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.711133] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 513e35e4-7ec3-4b36-82b0-b70d98706831 with status ACTIVE [ 992.711495] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.711578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.711623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.711832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.711922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.712124] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.712252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.712295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.712421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.712496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.712672] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.712789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.712844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.712963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.713098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.713207] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 513e35e4-7ec3-4b36-82b0-b70d98706831 is going to be updated. [ 992.731875] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.732067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.732143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.732316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.732453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.732620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-513e35e4-7ec3-4b36-82b0-b70d98706831" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.615954] env[62620]: INFO networking_nsxv3.common.synchronization [req-49e07426-1413-412e-b578-daf14e725031 req-b79b3efb-af0e-4306-ae60-a0062fd2f9c8 tempest-ServerRescueTestJSON-1890721172 tempest-ServerRescueTestJSON-1890721172-project-member] Enqueued Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 993.620463] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGHEST for action security_group_members [ 993.620463] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.620463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.620463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.620463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.620989] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.621666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.621805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.622051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.622606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.622759] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.999146] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 993.999518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.999518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.999758] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.999943] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.000076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.000161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.000351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.000447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.000569] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.126920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.127143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.127222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.127462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.127555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.127817] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.127902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.127935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.128090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.128158] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.128247] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 is going to be updated. [ 994.166367] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.166454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.166494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.166739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.166847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.178249] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: IN_PROGRESS for 2s [ 994.503442] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.006746] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.513941] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.513941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.513941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.513941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.513941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.513941] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 995.537472] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.537699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.537786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.538048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.538415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.548087] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 996.120311] env[62620]: INFO networking_nsxv3.common.synchronization [req-798bf817-78f4-4d2b-a86e-1b269286aa0d req-83af0b65-6150-41bc-b7df-aedc915bac08 tempest-ImagesOneServerNegativeTestJSON-1314187372 tempest-ImagesOneServerNegativeTestJSON-1314187372-project-member] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 996.120830] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 996.121160] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.121284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.121346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.121549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.121701] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.121796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.121859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.122013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.122443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.122443] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.188531] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 in Status: SUCCESS [ 996.188671] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 deletion is rescheduled due to dependency. [ 996.188805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.394019] env[62620]: INFO networking_nsxv3.common.synchronization [req-373561da-fdef-442a-9eb3-d20cfdbb24c1 req-7ac46536-a86a-4130-8dd1-32a2431f9b07 tempest-MigrationsAdminTest-1384528618 tempest-MigrationsAdminTest-1384528618-project-member] Enqueued Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 996.394019] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 996.394519] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.394819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.395018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.397084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.397084] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.397084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.397084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.397084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.397084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.397084] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.625543] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.625701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.625778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.625989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.626117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.626301] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.626455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.626455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.626608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.627072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.627072] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be updated. [ 996.656187] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.656536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.656650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.656884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.657068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.665691] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: IN_PROGRESS for 2s [ 996.898665] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.401778] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.557961] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 997.559230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.559230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.559230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.559230] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.559417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.559417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.559553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.559633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.559718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.559826] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.561399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.561602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.561805] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.561939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.562033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.562201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.562307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.562422] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.904593] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.904781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.904822] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.905073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.905217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.905326] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b is going to be updated. [ 997.936200] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.936200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.936459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.936606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.936827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.946660] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: IN_PROGRESS for 2s [ 998.064674] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.065060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.065311] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.567765] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.675090] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 998.675352] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 deletion is rescheduled due to dependency. [ 998.675477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.711633] env[62620]: INFO networking_nsxv3.common.synchronization [req-55fd1ae7-7d25-4b8a-be92-dc0f872d015e req-1217ab09-503e-4ff4-9920-8543afa1ffc6 tempest-VolumesAdminNegativeTest-1197893955 tempest-VolumesAdminNegativeTest-1197893955-project-member] Enqueued Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_members [ 998.712470] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGHEST for action security_group_members [ 998.712802] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.712929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.713012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.713604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.713774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.713883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.713946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.714121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.714212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.714310] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.783248] env[62620]: INFO networking_nsxv3.common.synchronization [None req-1d7c9b30-8d4d-4c62-8d40-60bbd4b5bf95 None None] Enqueued Resource ID: cce829ae-e5e3-4903-8229-d4093cb2f2df with Priority: HIGHEST for action port [ 998.783997] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce829ae-e5e3-4903-8229-d4093cb2f2df with Priority: HIGHEST for action port [ 998.784339] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-cce829ae-e5e3-4903-8229-d4093cb2f2df taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.784967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cce829ae-e5e3-4903-8229-d4093cb2f2df" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.785052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cce829ae-e5e3-4903-8229-d4093cb2f2df" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.785370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cce829ae-e5e3-4903-8229-d4093cb2f2df" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.785454] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cce829ae-e5e3-4903-8229-d4093cb2f2df',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.070178] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.070339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.070410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.070637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.070730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.071342] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 999.112838] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.112973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.113098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.113325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.113469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.124848] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 999.216350] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.216522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.216583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.216803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.268797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.269097] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.269225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.269294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.269503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.269591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.269681] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 is going to be updated. [ 999.287404] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cce829ae-e5e3-4903-8229-d4093cb2f2df [ 999.287785] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.287785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.287926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.288089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.288169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.288269] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cce829ae-e5e3-4903-8229-d4093cb2f2df already deleted. [ 999.288353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cce829ae-e5e3-4903-8229-d4093cb2f2df" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.335778] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.335932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.336048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.336369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.336551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.354166] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 in Status: IN_PROGRESS for 2s [ 999.955710] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: SUCCESS [ 999.956062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.317865] env[62620]: INFO networking_nsxv3.common.synchronization [req-8c61faa2-19c8-40f2-94d8-0f5e5fdb5841 req-1a2b183b-9714-4429-bd73-2fb371c3e069 tempest-ServersNegativeTestMultiTenantJSON-782874356 tempest-ServersNegativeTestMultiTenantJSON-782874356-project-member] Enqueued Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGHEST for action security_group_members [ 1000.320142] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGHEST for action security_group_members [ 1000.320142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.320142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.320142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.320142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.320142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.320142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.320142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.320142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.320142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.320142] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ed70962-84b7-45d9-83bd-fb99f1d14ad7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.650362] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.650563] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-896" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.650692] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-896" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.651054] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-896" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.651330] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.651490] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.651606] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.651818] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.651959] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.652183] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.652297] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.652408] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.652518] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.652629] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.652735] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.652867] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.670314] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.670464] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1000.670566] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.670747] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-896" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.671078] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-85488276-f200-4480-ace3-01452fa9a93f taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.671261] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-85488276-f200-4480-ace3-01452fa9a93f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.671388] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-85488276-f200-4480-ace3-01452fa9a93f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.671751] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-85488276-f200-4480-ace3-01452fa9a93f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.671900] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85488276-f200-4480-ace3-01452fa9a93f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.823677] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.823844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.823919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.824429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.824429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.824559] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.824559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.824685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.824781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.824825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.825205] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 already deleted. [ 1000.825205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.101851] env[62620]: INFO networking_nsxv3.common.synchronization [None req-907714e0-030d-4f4c-83d4-43eac6f9efe4 None None] Enqueued Resource ID: 85c14457-31e7-49c7-aef0-3147ceceff7d with Priority: HIGHEST for action port [ 1001.102111] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85c14457-31e7-49c7-aef0-3147ceceff7d with Priority: HIGHEST for action port [ 1001.102616] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-85c14457-31e7-49c7-aef0-3147ceceff7d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.102745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85c14457-31e7-49c7-aef0-3147ceceff7d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.102799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85c14457-31e7-49c7-aef0-3147ceceff7d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.103212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85c14457-31e7-49c7-aef0-3147ceceff7d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.103302] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c14457-31e7-49c7-aef0-3147ceceff7d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.134495] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 1001.134495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.134673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.134764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.134941] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.135077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.135191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.135308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.135387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.135475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.135628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.135847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.135847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.135963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.139292] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.139456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.139528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.139690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.139772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.139859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.139952] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.175970] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.176262] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.176459] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.178912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.178912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.178912] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 85488276-f200-4480-ace3-01452fa9a93f not found, creating... [ 1001.178912] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.178912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.178912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.178912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.178912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.178912] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.179376] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.179588] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.179756] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.180327] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.180327] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 85488276-f200-4480-ace3-01452fa9a93f is going to be created. [ 1001.203649] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.203860] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.204017] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.204325] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.204560] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.204785] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-85488276-f200-4480-ace3-01452fa9a93f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.364268] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 in Status: SUCCESS [ 1001.364442] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 deletion is rescheduled due to dependency. [ 1001.364559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.606729] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85c14457-31e7-49c7-aef0-3147ceceff7d [ 1001.606729] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.606729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.606729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.606729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.606729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.606729] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85c14457-31e7-49c7-aef0-3147ceceff7d already deleted. [ 1001.606729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85c14457-31e7-49c7-aef0-3147ceceff7d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.643041] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 787f7736-c1a9-4a6d-8e59-532c4a82467e: rpc.has_security_group_logging(os_id): False [ 1001.664584] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.664742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.664817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.665059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.665209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.665446] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.665549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.666072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.666072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.666072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.666072] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.666319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.666319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.666379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.666466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.666661] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.666763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.666830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.666980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.667069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.667154] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 1001.738722] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.738860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.738946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.739165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.739313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.750451] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 1001.900982] env[62620]: INFO networking_nsxv3.common.synchronization [req-8c61faa2-19c8-40f2-94d8-0f5e5fdb5841 req-827c1d85-11c1-447c-b681-4a85e5b70689 service nova] Enqueued Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGHEST for action security_group_rules [ 1001.901871] env[62620]: INFO networking_nsxv3.common.synchronization [req-8c61faa2-19c8-40f2-94d8-0f5e5fdb5841 req-827c1d85-11c1-447c-b681-4a85e5b70689 service nova] Enqueued Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGHEST for action security_group_members [ 1001.901871] env[62620]: INFO networking_nsxv3.common.synchronization [req-8c61faa2-19c8-40f2-94d8-0f5e5fdb5841 req-827c1d85-11c1-447c-b681-4a85e5b70689 service nova] Enqueued Resource ID: 85488276-f200-4480-ace3-01452fa9a93f with Priority: HIGHEST for action port [ 1001.902108] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGHEST for action security_group_rules [ 1001.902270] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGHEST for action security_group_members [ 1001.902680] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85488276-f200-4480-ace3-01452fa9a93f with Priority: HIGHEST for action port [ 1001.902860] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.902990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.903113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.903441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.903529] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ed70962-84b7-45d9-83bd-fb99f1d14ad7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.905394] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.905394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.905394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.905394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.905394] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.905394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.905394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.905394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.905394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.905726] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ed70962-84b7-45d9-83bd-fb99f1d14ad7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.907627] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-85488276-f200-4480-ace3-01452fa9a93f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.907627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85488276-f200-4480-ace3-01452fa9a93f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.907627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85488276-f200-4480-ace3-01452fa9a93f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.907627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85488276-f200-4480-ace3-01452fa9a93f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.907627] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85488276-f200-4480-ace3-01452fa9a93f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.408467] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.408764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.408830] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85488276-f200-4480-ace3-01452fa9a93f with status ACTIVE [ 1002.409009] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.409124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.409194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.409468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.409612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.409747] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.409843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.409903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.410076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.410154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.410359] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.410423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.410539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.410656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.410777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.410821] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85488276-f200-4480-ace3-01452fa9a93f is going to be updated. [ 1002.411905] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ed70962-84b7-45d9-83bd-fb99f1d14ad7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.431022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.431197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.431284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.431531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.431624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.431731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85488276-f200-4480-ace3-01452fa9a93f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.914112] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ed70962-84b7-45d9-83bd-fb99f1d14ad7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.417037] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.417037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.417037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.417412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.417412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.417474] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 is going to be created. [ 1003.442156] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.442372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.442484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.442794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.443053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.451388] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 in Status: UNINITIALIZED for 2s [ 1003.764137] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 1003.764419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.764638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.764881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.764968] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.267573] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.267732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.267783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.268015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.268365] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.268365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.268365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.268516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.268585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.268677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.268765] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.751638] env[62620]: INFO networking_nsxv3.common.synchronization [req-eb3833de-d679-49df-8c4f-61fa547f46fd req-a4e7f4d4-c2b9-4a1e-a099-2eea2cc16f5c tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 1004.751638] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 1004.752083] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.752083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.752083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.752205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.752307] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.752401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.752464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.752608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.752692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.752784] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.771390] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.771390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.006906] env[62620]: INFO networking_nsxv3.common.synchronization [req-eb3833de-d679-49df-8c4f-61fa547f46fd req-92e787dc-df18-4e21-bf19-dffe2c7a1caf tempest-ServersTestMultiNic-134641580 tempest-ServersTestMultiNic-134641580-project-member] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 1005.007450] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGHEST for action security_group_members [ 1005.007831] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.007952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.255229] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.461068] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 in Status: SUCCESS [ 1005.461294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.461455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.461671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.461857] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.461971] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.462050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.462206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.462287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.462372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.462462] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ed70962-84b7-45d9-83bd-fb99f1d14ad7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.758077] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.968047] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.968047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.968047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.968320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.968320] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.968406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.968406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.968572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.968624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.968716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.968868] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.968960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.969035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.969179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.969316] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.969660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.969660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.969660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.969660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.969825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.969825] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ed70962-84b7-45d9-83bd-fb99f1d14ad7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.260066] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.260235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.260310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.260949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.261095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.261208] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 1006.287880] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.288085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.288157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.288407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.288556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.296225] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 1006.472081] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ed70962-84b7-45d9-83bd-fb99f1d14ad7: rpc.has_security_group_logging(os_id): False [ 1006.489072] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.489224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.489439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.489513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.489609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.489831] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.489933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.489994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.490170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.490248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.490426] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.490523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.490588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.490726] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.490801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.490978] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.491275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.491386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.491578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.491705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.491831] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 is going to be created. [ 1006.545114] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.545328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.545412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.545630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.545809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.554792] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 in Status: IN_PROGRESS for 2s [ 1006.637479] env[62620]: INFO networking_nsxv3.common.synchronization [req-928bd9ac-1f58-4354-8977-49d97828f635 req-edc591e1-e9ee-42a0-b829-e66b81511339 tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1006.638038] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1006.638350] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.638472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.638541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.638735] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.638882] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.638974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.639589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.639589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.639589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.639713] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.083807] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.084424] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.084424] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.084515] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.084742] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.084914] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.089104] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.089389] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.089606] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.089770] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.089892] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.090015] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.090138] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.090257] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.090371] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.090568] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.109034] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.109287] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1007.109469] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.109653] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.109994] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-21eb745b-bf3f-4539-b50e-df8c6ff07be1 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.110632] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-21eb745b-bf3f-4539-b50e-df8c6ff07be1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.110632] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-21eb745b-bf3f-4539-b50e-df8c6ff07be1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.110632] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-21eb745b-bf3f-4539-b50e-df8c6ff07be1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.110774] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21eb745b-bf3f-4539-b50e-df8c6ff07be1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.142165] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.142328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.142403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.142613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.142708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.142902] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.143010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.143081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.143350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.143436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.143524] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1007.169021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.169021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.169021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.169021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.169021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.184910] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1007.612960] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.613210] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.613343] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.613641] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.613794] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.613953] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 21eb745b-bf3f-4539-b50e-df8c6ff07be1 not found, creating... [ 1007.614229] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.614394] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.614525] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.614741] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.614879] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.615177] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.615456] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.615717] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.615790] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.615924] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.616159] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 21eb745b-bf3f-4539-b50e-df8c6ff07be1 is going to be created. [ 1007.634490] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.634686] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.634814] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.635067] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.635345] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.636436] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-21eb745b-bf3f-4539-b50e-df8c6ff07be1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.305988] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 1008.306345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.306404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.306751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.306886] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.307087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.307201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.307427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.307545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.307652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.307898] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.308047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.308162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.308274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.308429] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.308535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.308598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.308737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.308813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.308893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.308978] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.309885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.310052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.310205] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.310335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.310431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.310642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.310735] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.310823] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.394258] env[62620]: INFO networking_nsxv3.common.synchronization [req-928bd9ac-1f58-4354-8977-49d97828f635 req-803a283a-f929-4dbd-8fe7-426b5b6d93b8 service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 1008.394258] env[62620]: INFO networking_nsxv3.common.synchronization [req-928bd9ac-1f58-4354-8977-49d97828f635 req-803a283a-f929-4dbd-8fe7-426b5b6d93b8 service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1008.394258] env[62620]: INFO networking_nsxv3.common.synchronization [req-928bd9ac-1f58-4354-8977-49d97828f635 req-803a283a-f929-4dbd-8fe7-426b5b6d93b8 service nova] Enqueued Resource ID: 21eb745b-bf3f-4539-b50e-df8c6ff07be1 with Priority: HIGHEST for action port [ 1008.394258] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 1008.394258] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1008.394258] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21eb745b-bf3f-4539-b50e-df8c6ff07be1 with Priority: HIGHEST for action port [ 1008.394837] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.395451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.396121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.396807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.397198] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.399551] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.399797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.400123] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-21eb745b-bf3f-4539-b50e-df8c6ff07be1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.400345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21eb745b-bf3f-4539-b50e-df8c6ff07be1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.400794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21eb745b-bf3f-4539-b50e-df8c6ff07be1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.400794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21eb745b-bf3f-4539-b50e-df8c6ff07be1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.401068] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21eb745b-bf3f-4539-b50e-df8c6ff07be1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.566518] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 in Status: SUCCESS [ 1008.566518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.812634] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 787f7736-c1a9-4a6d-8e59-532c4a82467e: rpc.has_security_group_logging(os_id): False [ 1008.816522] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.816696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.816850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.816958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.817062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.817261] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.817360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.817472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.817596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.817679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.817768] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 1008.830258] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.830421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.830507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.830680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.831091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.831091] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.831091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.831302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.831302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.831394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.831536] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.831706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.831706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.831896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.831937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.832093] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.832186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.832241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.832380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.832451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.832526] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be updated. [ 1008.841039] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.841198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.841198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.841408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.841562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.848500] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 1008.892464] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.892760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.892760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.892978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.893141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.899886] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.899886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.903240] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21eb745b-bf3f-4539-b50e-df8c6ff07be1 with status ACTIVE [ 1008.903442] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.903541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.903603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.903799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.903883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.904104] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.904197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.904270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.904420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.904525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.904676] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.904803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.904836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.904958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.905141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.905141] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21eb745b-bf3f-4539-b50e-df8c6ff07be1 is going to be updated. [ 1008.918877] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: IN_PROGRESS for 2s [ 1008.930454] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.930676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.931180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.931180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.931314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.931430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21eb745b-bf3f-4539-b50e-df8c6ff07be1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.160361] env[62620]: INFO networking_nsxv3.common.synchronization [req-20c04bbf-d22d-4883-bb4d-6e14ab399e3e req-6566a4ae-09ca-4fd4-91c2-7c3b38a67366 tempest-ServersAdminTestJSON-158660873 tempest-ServersAdminTestJSON-158660873-project-member] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 1009.160889] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 1009.161210] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.161331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.161399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.161598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.161761] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.161834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.161899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.162125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.162542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.162542] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.208270] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1009.208601] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 1009.208601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.208710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.210110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.210110] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.210110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.210110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.210110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.210110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.210110] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.237450] env[62620]: INFO networking_nsxv3.common.synchronization [req-0334a4c4-ab3d-40e5-a2ef-fde26e7c01f6 req-7ae05750-a05e-4539-90ff-98e1d0cd6ab2 tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1009.238520] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1009.238832] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.240037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.240141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.240356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.240546] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.240978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.241061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.241221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.241313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.241411] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.648093] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.648423] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.648591] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.649302] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.649690] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.649954] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.650113] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.650469] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.650691] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.651882] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.651882] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.651882] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.651882] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.651882] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.651882] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.652149] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.666230] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.671761] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.671761] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.671761] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.671761] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.671761] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-28c58084-5681-433c-a2ce-043547a7f315 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.671761] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-28c58084-5681-433c-a2ce-043547a7f315" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.671761] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-28c58084-5681-433c-a2ce-043547a7f315" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.671761] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-28c58084-5681-433c-a2ce-043547a7f315" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.671761] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28c58084-5681-433c-a2ce-043547a7f315',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.712296] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.743744] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.168080] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.173377] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.173665] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.173876] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.174193] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.174395] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.174615] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 28c58084-5681-433c-a2ce-043547a7f315 not found, creating... [ 1010.174944] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.175134] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.175342] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.175624] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.175811] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.176158] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.176417] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.176584] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.176867] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.177060] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.177240] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 28c58084-5681-433c-a2ce-043547a7f315 is going to be created. [ 1010.203836] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.204036] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.204151] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.204444] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.204676] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.204892] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-28c58084-5681-433c-a2ce-043547a7f315" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.214439] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.245307] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.670072] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.670380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.670380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.670532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.670626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.670726] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 1010.697071] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.697226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.697277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.697475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.697624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.705516] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 1010.715946] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.716075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.716150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.716335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.716419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.716508] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1010.745435] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.745583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.745667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.745857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.745988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.747167] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.747282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.747350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.747512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.747662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.747754] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 1010.755960] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1010.771884] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.772046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.772121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.772343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.772496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.782405] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 1010.858731] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 1010.858883] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e deletion is rescheduled due to dependency. [ 1010.858955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.931997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e in Status: SUCCESS [ 1010.932326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.231127] env[62620]: INFO networking_nsxv3.common.synchronization [req-0334a4c4-ab3d-40e5-a2ef-fde26e7c01f6 req-f34bbe3c-bdd4-41ea-a7a5-b53e04a7902d service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 1011.231362] env[62620]: INFO networking_nsxv3.common.synchronization [req-0334a4c4-ab3d-40e5-a2ef-fde26e7c01f6 req-f34bbe3c-bdd4-41ea-a7a5-b53e04a7902d service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1011.231523] env[62620]: INFO networking_nsxv3.common.synchronization [req-0334a4c4-ab3d-40e5-a2ef-fde26e7c01f6 req-f34bbe3c-bdd4-41ea-a7a5-b53e04a7902d service nova] Enqueued Resource ID: 28c58084-5681-433c-a2ce-043547a7f315 with Priority: HIGHEST for action port [ 1011.231767] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 1011.231893] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1011.231988] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28c58084-5681-433c-a2ce-043547a7f315 with Priority: HIGHEST for action port [ 1011.232571] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.232699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.232768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.232976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.234153] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.235092] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.235263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.235500] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-28c58084-5681-433c-a2ce-043547a7f315 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.235652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28c58084-5681-433c-a2ce-043547a7f315" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.235738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28c58084-5681-433c-a2ce-043547a7f315" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.235951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28c58084-5681-433c-a2ce-043547a7f315" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.236066] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28c58084-5681-433c-a2ce-043547a7f315',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.738486] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.738761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.738822] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28c58084-5681-433c-a2ce-043547a7f315 with status ACTIVE [ 1011.739015] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.739149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.739229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.739395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.739518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.743283] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.743431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.743515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.743748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.743851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.744086] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.744208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.744276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.744449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.744551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.744646] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28c58084-5681-433c-a2ce-043547a7f315 is going to be updated. [ 1011.764955] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.765100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.765173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.765752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.765907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.766079] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28c58084-5681-433c-a2ce-043547a7f315" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.235584] env[62620]: INFO networking_nsxv3.common.synchronization [req-9e5840cb-5be2-4b36-8e58-0c5896dc6dc5 req-862d6684-7265-4a6e-9ea9-9e29c6b679b2 tempest-ServersNegativeTestMultiTenantJSON-782874356 tempest-ServersNegativeTestMultiTenantJSON-782874356-project-member] Enqueued Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGHEST for action security_group_members [ 1012.236178] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGHEST for action security_group_members [ 1012.236514] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.236639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.236706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.236904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.237657] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.237789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.237858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.238035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.238127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.238224] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ed70962-84b7-45d9-83bd-fb99f1d14ad7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.543656] env[62620]: INFO networking_nsxv3.common.synchronization [req-ae6b1cae-0174-4f2d-9eca-bbb146ac4472 req-5ea11496-27cc-4261-b40c-f0158857b2f7 tempest-MigrationsAdminTest-1384528618 tempest-MigrationsAdminTest-1384528618-project-member] Enqueued Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 1012.544186] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGHEST for action security_group_members [ 1012.544486] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.544606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.544672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.544918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.545196] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.545351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.545460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.545657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.545776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.545894] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.714745] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 1012.714972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.741171] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.741171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.741171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.741582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.741582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.741582] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.741716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.741764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.741902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.741984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.742112] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 is going to be updated. [ 1012.765716] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1012.768173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.768173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.768173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.768173] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.768173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.768173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.768173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.768173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.768173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.768173] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.770068] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.770322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.770471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.770700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.770928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.777300] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 in Status: IN_PROGRESS for 2s [ 1012.791129] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 1012.791129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.791129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.791129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.791401] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.791401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.791401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.792029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.792029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.792029] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.047617] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.047846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.047913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.048143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.068713] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.069033] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.069153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.069221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.069431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.069570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.069665] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b is going to be updated. [ 1013.093619] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.093813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.093850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.094111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.094306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.101991] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: IN_PROGRESS for 2s [ 1013.270545] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.270799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.270894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.271156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.271327] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.271465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.271535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.271714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.271805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.271894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.272103] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.272201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.272265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.272439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.272638] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.272772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.272806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.272929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.273015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.273105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.273195] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.294654] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.780251] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c469d6d-346a-40a2-adb5-8c50f7758224: rpc.has_security_group_logging(os_id): False [ 1013.796931] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.797147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.797195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.797370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.797457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.797668] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.797766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.797829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.797979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.798067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.798278] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.798369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.798428] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.798567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.798636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.798815] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.798942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.799284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.799491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.799611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.799730] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1013.800987] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.857411] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.857592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.857665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.857886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.858048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.865852] env[62620]: INFO networking_nsxv3.common.synchronization [req-115ac835-10e3-4f17-b8a1-8e6d27a00a51 req-0457400d-5f05-4bf3-83e4-e0746abc5d9d tempest-ServerMetadataTestJSON-2065088342 tempest-ServerMetadataTestJSON-2065088342-project-member] Enqueued Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGHEST for action security_group_members [ 1013.866472] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGHEST for action security_group_members [ 1013.866472] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-555614d8-7992-4190-9420-95843d76b986 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.866472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.866472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.866823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.868294] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.868294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.868294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.868294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.868294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.868294] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('555614d8-7992-4190-9420-95843d76b986',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.869378] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1014.180941] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.180941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-595" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.180941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-595" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.180941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-595" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.180941] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.181283] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.181283] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.181511] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.181734] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.182030] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.182164] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.182295] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.182407] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.182570] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.182709] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.182824] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.206814] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.207089] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1014.207273] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.207461] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-595" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.207842] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-86cb7370-5805-448b-bd4b-6204a2aa2a76 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.208047] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-86cb7370-5805-448b-bd4b-6204a2aa2a76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.208180] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-86cb7370-5805-448b-bd4b-6204a2aa2a76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.208488] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-86cb7370-5805-448b-bd4b-6204a2aa2a76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.208636] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86cb7370-5805-448b-bd4b-6204a2aa2a76',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.305608] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.305817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.305919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.308938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.308938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.308938] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 1014.341094] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.341187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.341221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.341432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.341578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.351313] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 1014.371208] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.371360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.371431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.371631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.371720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.371917] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.372060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.372150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.372363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.372441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.372526] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 555614d8-7992-4190-9420-95843d76b986 already deleted. [ 1014.372641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.713080] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.713080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.713080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.713080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.713080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.713080] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 86cb7370-5805-448b-bd4b-6204a2aa2a76 not found, creating... [ 1014.713080] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.713080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.713080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.713550] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.713550] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.713614] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.713740] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.713862] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.714092] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.714372] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.714372] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 86cb7370-5805-448b-bd4b-6204a2aa2a76 is going to be created. [ 1014.733414] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.733636] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.733768] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.734058] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.734409] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.734523] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-86cb7370-5805-448b-bd4b-6204a2aa2a76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.787303] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 in Status: SUCCESS [ 1014.787594] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 deletion is rescheduled due to dependency. [ 1014.787594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.111737] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: IN_PROGRESS for 4s [ 1015.467018] env[62620]: INFO networking_nsxv3.common.synchronization [req-115ac835-10e3-4f17-b8a1-8e6d27a00a51 req-a431a9cf-906a-43de-9aab-4a777c05d257 service nova] Enqueued Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGHEST for action security_group_rules [ 1015.467018] env[62620]: INFO networking_nsxv3.common.synchronization [req-115ac835-10e3-4f17-b8a1-8e6d27a00a51 req-a431a9cf-906a-43de-9aab-4a777c05d257 service nova] Enqueued Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGHEST for action security_group_members [ 1015.467018] env[62620]: INFO networking_nsxv3.common.synchronization [req-115ac835-10e3-4f17-b8a1-8e6d27a00a51 req-a431a9cf-906a-43de-9aab-4a777c05d257 service nova] Enqueued Resource ID: 86cb7370-5805-448b-bd4b-6204a2aa2a76 with Priority: HIGHEST for action port [ 1015.467018] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGHEST for action security_group_rules [ 1015.467018] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGHEST for action security_group_members [ 1015.467761] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86cb7370-5805-448b-bd4b-6204a2aa2a76 with Priority: HIGHEST for action port [ 1015.468244] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-555614d8-7992-4190-9420-95843d76b986 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.468472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.468616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.468944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.471699] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('555614d8-7992-4190-9420-95843d76b986',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.471699] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-555614d8-7992-4190-9420-95843d76b986 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.471699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.471699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.471699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.471699] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.471699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.471699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.471699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.471699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.471699] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('555614d8-7992-4190-9420-95843d76b986',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.471699] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-86cb7370-5805-448b-bd4b-6204a2aa2a76 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.472903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86cb7370-5805-448b-bd4b-6204a2aa2a76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.473125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86cb7370-5805-448b-bd4b-6204a2aa2a76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.473369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86cb7370-5805-448b-bd4b-6204a2aa2a76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.473528] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86cb7370-5805-448b-bd4b-6204a2aa2a76',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.882747] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1015.882747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.978019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-555614d8-7992-4190-9420-95843d76b986 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.978019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.978019] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('555614d8-7992-4190-9420-95843d76b986',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.978019] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86cb7370-5805-448b-bd4b-6204a2aa2a76 with status ACTIVE [ 1015.978019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.978019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.978019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.978019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.978019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.978019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.978019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.978019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.979055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.979344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.980129] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.980483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.980681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.983936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.983936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.983936] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86cb7370-5805-448b-bd4b-6204a2aa2a76 is going to be updated. [ 1016.010953] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.012552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.012552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.012552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.012552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.012552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86cb7370-5805-448b-bd4b-6204a2aa2a76" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.361804] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 1016.362074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.362320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.362588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.362881] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.363042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.363136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.363347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.363487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.363627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.363793] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.483805] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('555614d8-7992-4190-9420-95843d76b986',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.869026] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.869026] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.869026] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.869026] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.869026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.869643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.869643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.869643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.869643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.869643] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.989718] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.989718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.989718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.989718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.989718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.989718] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 555614d8-7992-4190-9420-95843d76b986 is going to be created. [ 1017.012511] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.013873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.013873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.013873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.013873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.027452] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 555614d8-7992-4190-9420-95843d76b986 in Status: UNINITIALIZED for 2s [ 1017.123687] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d45250-e90b-4ed6-befa-bdaacfced30b in Status: SUCCESS [ 1017.123687] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b deletion is rescheduled due to dependency. [ 1017.123687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.373562] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c995751-5151-4812-a1e5-510ea09222e0: rpc.has_security_group_logging(os_id): False [ 1017.392113] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.392348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.392348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.392560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.392641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.392844] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.393813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.393813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.393813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.393813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.395087] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.395087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.395087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.395087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.395087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.395087] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.395087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.395087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.395087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.395087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.397589] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 1017.464065] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.464065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.464065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.464065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.464065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.474783] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 1017.589783] env[62620]: INFO networking_nsxv3.common.synchronization [None req-357e21db-3294-44a6-a21e-8bb558026ac0 None None] Enqueued Resource ID: 9b7efcbc-6819-4d86-8606-27b1e9f0c019 with Priority: HIGHEST for action port [ 1017.589783] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7efcbc-6819-4d86-8606-27b1e9f0c019 with Priority: HIGHEST for action port [ 1017.590046] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b7efcbc-6819-4d86-8606-27b1e9f0c019 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.590569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b7efcbc-6819-4d86-8606-27b1e9f0c019" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.590682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b7efcbc-6819-4d86-8606-27b1e9f0c019" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.591021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b7efcbc-6819-4d86-8606-27b1e9f0c019" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.591114] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b7efcbc-6819-4d86-8606-27b1e9f0c019',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.093894] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b7efcbc-6819-4d86-8606-27b1e9f0c019 [ 1018.095614] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.095614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.095614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.095614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.095614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.095614] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b7efcbc-6819-4d86-8606-27b1e9f0c019 already deleted. [ 1018.095614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b7efcbc-6819-4d86-8606-27b1e9f0c019" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.269704] env[62620]: INFO networking_nsxv3.common.synchronization [req-db816bba-d86a-4648-8f18-747e9414dee5 req-3729b293-ec34-47fd-b118-55d19c64c30b tempest-ImagesOneServerNegativeTestJSON-1314187372 tempest-ImagesOneServerNegativeTestJSON-1314187372-project-member] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 1018.270365] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 1018.270690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.270809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.270876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.274195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.274399] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.274548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.274585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.274764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.274855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.274953] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.742889] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.742889] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.742889] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.743236] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.744137] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.744137] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.744137] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.744137] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.744371] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.744559] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.744715] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.744958] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.745096] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.745249] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.745423] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.745607] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.764221] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.764384] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.764562] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.764686] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-94" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.765093] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-1dbb6dda-f003-4949-8bd8-ae4bd148a135 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.765281] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-1dbb6dda-f003-4949-8bd8-ae4bd148a135" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.765484] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-1dbb6dda-f003-4949-8bd8-ae4bd148a135" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.765834] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-1dbb6dda-f003-4949-8bd8-ae4bd148a135" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.766705] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dbb6dda-f003-4949-8bd8-ae4bd148a135',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.777721] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.778322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.778495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.778892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.779036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.779848] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.780049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.780097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.780309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.780364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.780481] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be updated. [ 1018.805890] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.806550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.806674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.806853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.808481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.816780] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: IN_PROGRESS for 2s [ 1019.037348] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 555614d8-7992-4190-9420-95843d76b986 in Status: SUCCESS [ 1019.037560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.037756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.037984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.038466] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.038466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.038466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.038684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.038684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.038787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.039187] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('555614d8-7992-4190-9420-95843d76b986',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.268874] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.269248] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.269248] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.270021] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.270021] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.270021] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 1dbb6dda-f003-4949-8bd8-ae4bd148a135 not found, creating... [ 1019.270183] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.270421] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.270421] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.270678] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.270826] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.273816] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.273999] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.274149] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.274389] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.274537] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.274688] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 1dbb6dda-f003-4949-8bd8-ae4bd148a135 is going to be created. [ 1019.293391] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.293761] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.294042] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.294364] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.294641] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.294918] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-1dbb6dda-f003-4949-8bd8-ae4bd148a135" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.488823] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 1019.489065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.544828] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-555614d8-7992-4190-9420-95843d76b986 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.544986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.545089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.545343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.545546] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.545642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.545708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.545866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.545951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.546054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.546204] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-555614d8-7992-4190-9420-95843d76b986 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.546426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.546426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.546552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.546670] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.546765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.546820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.546957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.547125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.547125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.547233] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('555614d8-7992-4190-9420-95843d76b986',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.761273] env[62620]: INFO networking_nsxv3.common.synchronization [None req-2dbf4795-bfb7-4106-90a2-a9c939619afc None None] Enqueued Resource ID: ae1a1a54-cb9f-4b2f-8796-0245ab162de4 with Priority: HIGHEST for action port [ 1019.761273] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae1a1a54-cb9f-4b2f-8796-0245ab162de4 with Priority: HIGHEST for action port [ 1019.761273] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae1a1a54-cb9f-4b2f-8796-0245ab162de4 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.761273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae1a1a54-cb9f-4b2f-8796-0245ab162de4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.761273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae1a1a54-cb9f-4b2f-8796-0245ab162de4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.761273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae1a1a54-cb9f-4b2f-8796-0245ab162de4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.761273] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae1a1a54-cb9f-4b2f-8796-0245ab162de4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.050767] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 555614d8-7992-4190-9420-95843d76b986: rpc.has_security_group_logging(os_id): False [ 1020.067276] env[62620]: INFO networking_nsxv3.common.synchronization [req-db816bba-d86a-4648-8f18-747e9414dee5 req-26c4b92f-1abb-474a-9bbc-674e2d364a18 service nova] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_rules [ 1020.067276] env[62620]: INFO networking_nsxv3.common.synchronization [req-db816bba-d86a-4648-8f18-747e9414dee5 req-26c4b92f-1abb-474a-9bbc-674e2d364a18 service nova] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 1020.067276] env[62620]: INFO networking_nsxv3.common.synchronization [req-db816bba-d86a-4648-8f18-747e9414dee5 req-26c4b92f-1abb-474a-9bbc-674e2d364a18 service nova] Enqueued Resource ID: 1dbb6dda-f003-4949-8bd8-ae4bd148a135 with Priority: HIGHEST for action port [ 1020.067276] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_rules [ 1020.067276] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 1020.067276] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dbb6dda-f003-4949-8bd8-ae4bd148a135 with Priority: HIGHEST for action port [ 1020.067276] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.067276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.067276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.067276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.067276] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.068446] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.068805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.069157] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dbb6dda-f003-4949-8bd8-ae4bd148a135 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.069423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dbb6dda-f003-4949-8bd8-ae4bd148a135" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.070090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dbb6dda-f003-4949-8bd8-ae4bd148a135" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.070090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dbb6dda-f003-4949-8bd8-ae4bd148a135" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.070090] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dbb6dda-f003-4949-8bd8-ae4bd148a135',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.075440] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.075440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.075440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.075687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.075687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.075870] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.075972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.076061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.076252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.076335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.076546] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.076643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.076705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.076860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.077508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.077508] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.077508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.077508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.077508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.077723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.077723] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 555614d8-7992-4190-9420-95843d76b986 is going to be created. [ 1020.134694] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.134891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.134891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.135135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.135362] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.144802] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 555614d8-7992-4190-9420-95843d76b986 in Status: IN_PROGRESS for 2s [ 1020.263031] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae1a1a54-cb9f-4b2f-8796-0245ab162de4 [ 1020.263275] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.263409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.263479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.263704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.263793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.263889] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae1a1a54-cb9f-4b2f-8796-0245ab162de4 already deleted. [ 1020.263973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae1a1a54-cb9f-4b2f-8796-0245ab162de4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.574332] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.574614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.580126] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1dbb6dda-f003-4949-8bd8-ae4bd148a135 with status ACTIVE [ 1020.580441] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.580714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.580793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.581075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.581240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.581564] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.581740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.581859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.582164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.582321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.582632] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.582815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.582917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.583163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.583294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.583424] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1dbb6dda-f003-4949-8bd8-ae4bd148a135 is going to be updated. [ 1020.610515] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.610515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.610966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.610966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.611595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.611595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dbb6dda-f003-4949-8bd8-ae4bd148a135" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.827898] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 1020.828190] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 deletion is rescheduled due to dependency. [ 1020.828321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.828488] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.828709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.828893] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.829023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.829086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.829295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.829380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.829478] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.332981] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.835625] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.913331] env[62620]: INFO networking_nsxv3.common.synchronization [req-42a3e783-672b-4d5a-97e5-15db9d0f6ba5 req-0243ec6b-f799-4922-8e10-0a168cfdd9a6 tempest-ServersAdminTestJSON-158660873 tempest-ServersAdminTestJSON-158660873-project-member] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 1021.913331] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGHEST for action security_group_members [ 1021.914496] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.915113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.916168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.916540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.916921] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.917114] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.917214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.917433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.917557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.917704] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.157566] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 555614d8-7992-4190-9420-95843d76b986 in Status: SUCCESS [ 1022.157858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.337119] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.337310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.337310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.337591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.337591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.337763] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be updated. [ 1022.365706] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.365849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.365913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.366852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.367154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.376142] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: IN_PROGRESS for 2s [ 1022.422959] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.423220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.423220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.423653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.444249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.444249] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.444370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.444439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.444691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.444806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.444925] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be updated. [ 1022.472977] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.473271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.473394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.473643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.473838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.481361] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: IN_PROGRESS for 2s [ 1024.387701] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 1024.388090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.388447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.388593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.388800] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.388912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.388978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.390198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.390198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.390198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.390198] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.493139] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b140e556-13f7-4e22-a7d6-53ddc3943100 in Status: SUCCESS [ 1024.493139] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 deletion is rescheduled due to dependency. [ 1024.493139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.891405] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.891529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.891601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.891827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.891994] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.892111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.892174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.892323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.892410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.892499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.892644] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.892736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.892798] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.892937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.893097] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.893189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.893265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.893474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.893558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.893640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.893732] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.397790] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95e0473d-1c6d-4b24-a6d9-f419a29f67f5: rpc.has_security_group_logging(os_id): False [ 1025.415187] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.415187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.415187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.415469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.415572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.415849] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.415980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.416107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.416315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.416534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.416801] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.416897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.416965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.417117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.418757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.418757] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.418757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.418757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.418757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.418757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.418757] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be updated. [ 1025.473167] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.473337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.473399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.473704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.473804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.485764] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: IN_PROGRESS for 2s [ 1026.913845] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1026.914158] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1027.499910] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 1027.500167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.558667] env[62620]: INFO networking_nsxv3.common.synchronization [req-ebc83ef4-9d7d-46cb-bc53-587dcd73092f req-192a8d38-8f0d-4e46-8dc2-b7070cafdfbb tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1028.559271] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1028.559990] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.560138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.560209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.560528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.560607] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.560684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.561043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.561043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.561043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.561043] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.062937] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.567802] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.733571] env[62620]: INFO networking_nsxv3.common.synchronization [None req-4a51ef46-3d3d-4ed9-bb78-73725ab1d983 None None] Enqueued Resource ID: 90684fd8-32b1-4d5e-bbe4-03a4891812c6 with Priority: HIGHEST for action port [ 1029.733571] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90684fd8-32b1-4d5e-bbe4-03a4891812c6 with Priority: HIGHEST for action port [ 1029.733571] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-90684fd8-32b1-4d5e-bbe4-03a4891812c6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.733571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90684fd8-32b1-4d5e-bbe4-03a4891812c6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.733571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90684fd8-32b1-4d5e-bbe4-03a4891812c6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.733571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90684fd8-32b1-4d5e-bbe4-03a4891812c6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.733571] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90684fd8-32b1-4d5e-bbe4-03a4891812c6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.070290] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.070585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.070585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.070856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.070906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.071016] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 1030.100125] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.100296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.100296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.100464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.100607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.108376] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 1030.236423] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90684fd8-32b1-4d5e-bbe4-03a4891812c6 [ 1030.236423] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.236423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.236423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.236793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.236793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.236889] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90684fd8-32b1-4d5e-bbe4-03a4891812c6 already deleted. [ 1030.236924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90684fd8-32b1-4d5e-bbe4-03a4891812c6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.833489] env[62620]: INFO networking_nsxv3.common.synchronization [req-7fcb77fa-f30d-4201-a41e-5a196fddd83d req-f8ccf42a-5b9e-4218-9791-d201a1e8a8ce tempest-ServerMetadataTestJSON-2065088342 tempest-ServerMetadataTestJSON-2065088342-project-member] Enqueued Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGHEST for action security_group_members [ 1030.834108] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGHEST for action security_group_members [ 1030.834649] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-555614d8-7992-4190-9420-95843d76b986 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.834649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.834649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.834925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.835386] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.835386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.835386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.835657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.835657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.835739] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('555614d8-7992-4190-9420-95843d76b986',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.338613] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.338769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.338843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.339076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.339171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.339366] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.339463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.339521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.339883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.339883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.339883] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 555614d8-7992-4190-9420-95843d76b986 is going to be updated. [ 1031.364306] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.364306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.364306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.364306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.364604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.371714] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 555614d8-7992-4190-9420-95843d76b986 in Status: IN_PROGRESS for 2s [ 1031.704377] env[62620]: INFO networking_nsxv3.common.synchronization [req-80003f26-d1e9-4774-bc0c-64bc7f5e2a38 req-9581140e-9d55-412a-82ca-870833cca6e0 tempest-ImagesOneServerNegativeTestJSON-1314187372 tempest-ImagesOneServerNegativeTestJSON-1314187372-project-member] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 1031.704990] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGHEST for action security_group_members [ 1031.705317] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.705469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.705531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.706455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.706455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.706455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.707122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.707329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.707424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.707528] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.117483] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 1032.117833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.211551] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.211726] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.211800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.212038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.212135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.212336] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.212436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.212499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.212655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.212730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.212816] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be updated. [ 1032.243896] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.244092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.244178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.244390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.244549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.254409] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: IN_PROGRESS for 2s [ 1032.270520] env[62620]: INFO networking_nsxv3.common.synchronization [None req-0be99139-ac5b-4659-93e2-6589c823d258 None None] Enqueued Resource ID: 87ce0bfc-4336-4f9a-b793-c65c04e60f9d with Priority: HIGHEST for action port [ 1032.271256] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87ce0bfc-4336-4f9a-b793-c65c04e60f9d with Priority: HIGHEST for action port [ 1032.271570] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-87ce0bfc-4336-4f9a-b793-c65c04e60f9d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.271684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87ce0bfc-4336-4f9a-b793-c65c04e60f9d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.271749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87ce0bfc-4336-4f9a-b793-c65c04e60f9d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.272167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87ce0bfc-4336-4f9a-b793-c65c04e60f9d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.272287] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87ce0bfc-4336-4f9a-b793-c65c04e60f9d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.774635] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87ce0bfc-4336-4f9a-b793-c65c04e60f9d [ 1032.774912] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.775083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.775186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.775476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.775577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.775694] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87ce0bfc-4336-4f9a-b793-c65c04e60f9d already deleted. [ 1032.775795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87ce0bfc-4336-4f9a-b793-c65c04e60f9d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.380638] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 555614d8-7992-4190-9420-95843d76b986 in Status: SUCCESS [ 1033.380951] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 555614d8-7992-4190-9420-95843d76b986 deletion is rescheduled due to dependency. [ 1033.380951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.450466] env[62620]: INFO networking_nsxv3.common.synchronization [None req-e7cbf191-6750-4943-9281-3374fb214d0f None None] Enqueued Resource ID: acfa3e6f-6e60-4471-adb1-973998608fbd with Priority: HIGHEST for action port [ 1033.450715] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acfa3e6f-6e60-4471-adb1-973998608fbd with Priority: HIGHEST for action port [ 1033.451303] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-acfa3e6f-6e60-4471-adb1-973998608fbd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.451472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acfa3e6f-6e60-4471-adb1-973998608fbd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.451544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acfa3e6f-6e60-4471-adb1-973998608fbd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.451809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acfa3e6f-6e60-4471-adb1-973998608fbd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.451879] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acfa3e6f-6e60-4471-adb1-973998608fbd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.954156] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acfa3e6f-6e60-4471-adb1-973998608fbd [ 1033.954463] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.954648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.954744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.955042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.955195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.955364] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acfa3e6f-6e60-4471-adb1-973998608fbd already deleted. [ 1033.955565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acfa3e6f-6e60-4471-adb1-973998608fbd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.042307] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d87a2c34-d862-4464-aa33-3eac4162506c tempest-ServersTestFqdnHostnames-27247144 tempest-ServersTestFqdnHostnames-27247144-project-member] Enqueued Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_rules [ 1034.042843] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_rules [ 1034.043174] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84fabf93-4432-40c4-890b-0bf1580dbb93 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.043295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.043351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.043667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.043737] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.125046] env[62620]: INFO networking_nsxv3.common.synchronization [None req-11b1fbdb-a503-4687-8a1b-837962602b6c tempest-ServersTestFqdnHostnames-27247144 tempest-ServersTestFqdnHostnames-27247144-project-member] Enqueued Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_rules [ 1034.125438] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_rules [ 1034.125800] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84fabf93-4432-40c4-890b-0bf1580dbb93 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.125924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.265030] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 in Status: SUCCESS [ 1034.265175] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 deletion is rescheduled due to dependency. [ 1034.265293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.565111] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.565540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.565540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.565540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.565540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.565703] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 already deleted. [ 1034.565703] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.565833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.565986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.566081] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.083879] env[62620]: INFO networking_nsxv3.common.synchronization [req-0a3604f4-6f17-4d5c-bc87-997035436c17 req-b3843e33-261c-4a39-b46c-2fb9e118aa95 tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1035.084659] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1035.085979] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.086289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.086864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.086864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.087433] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.087433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.087433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.087621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.088193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.088378] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.090551] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.090734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.090852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.091112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.091247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.091386] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 already deleted. [ 1035.091518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.338907] env[62620]: INFO networking_nsxv3.common.synchronization [req-3c6ffc6e-569b-4693-bf7f-a3fc811b2ec9 req-b4122267-92d1-4ff4-9e0e-134fdc48c75d tempest-TenantUsagesTestJSON-1395357459 tempest-TenantUsagesTestJSON-1395357459-project-member] Enqueued Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGHEST for action security_group_members [ 1035.339448] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGHEST for action security_group_members [ 1035.339751] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-94560eb7-1f11-45b3-b778-974dbd9c0094 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.339873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.339943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.343694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.343694] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.343694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.343694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.343694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.343694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.343694] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94560eb7-1f11-45b3-b778-974dbd9c0094',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.523251] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b5fa0637-df8a-42a0-8fe8-deceb4e103ed None None] Enqueued Resource ID: 5f93ea3c-1b08-444c-9ded-c57aaca4df79 with Priority: HIGHEST for action port [ 1035.526146] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f93ea3c-1b08-444c-9ded-c57aaca4df79 with Priority: HIGHEST for action port [ 1035.526815] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f93ea3c-1b08-444c-9ded-c57aaca4df79 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.527060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f93ea3c-1b08-444c-9ded-c57aaca4df79" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.527060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f93ea3c-1b08-444c-9ded-c57aaca4df79" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.527291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f93ea3c-1b08-444c-9ded-c57aaca4df79" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.527375] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f93ea3c-1b08-444c-9ded-c57aaca4df79',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.594340] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.594616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.594616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.594832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.594867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.595075] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.595167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.595233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.596064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.596064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.596064] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 1035.622622] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.622622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.622622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.622756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.622852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.631833] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 1035.647533] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.647739] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.647916] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.648223] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.648494] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.648663] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.648785] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.649007] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.652871] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.652871] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1035.652871] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.653033] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.653070] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.653236] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1035.653293] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.653424] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.671709] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.673133] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1035.673133] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.673133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-271" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.673133] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-3597f9e3-4248-4b24-b7ca-bce13900128a taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.673133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-3597f9e3-4248-4b24-b7ca-bce13900128a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.673133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-3597f9e3-4248-4b24-b7ca-bce13900128a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.673746] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-3597f9e3-4248-4b24-b7ca-bce13900128a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.673746] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3597f9e3-4248-4b24-b7ca-bce13900128a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.843976] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.844158] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.844395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.844473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.844523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.844719] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.844820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.844898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.845041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.845120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.845200] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 already deleted. [ 1035.845276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.030016] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f93ea3c-1b08-444c-9ded-c57aaca4df79 [ 1036.030016] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.030016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.030016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.030290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.030290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.030475] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f93ea3c-1b08-444c-9ded-c57aaca4df79 already deleted. [ 1036.030475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f93ea3c-1b08-444c-9ded-c57aaca4df79" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.176105] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.176378] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.176948] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.176948] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.176948] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.177131] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 3597f9e3-4248-4b24-b7ca-bce13900128a not found, creating... [ 1036.177405] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.177571] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.177699] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.177934] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.178096] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.178390] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.178554] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.178824] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.179093] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.179244] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.179392] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 3597f9e3-4248-4b24-b7ca-bce13900128a is going to be created. [ 1036.213704] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.213937] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.214082] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.214447] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.214685] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.215286] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-3597f9e3-4248-4b24-b7ca-bce13900128a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.960131] env[62620]: INFO networking_nsxv3.common.synchronization [req-3c6ffc6e-569b-4693-bf7f-a3fc811b2ec9 req-615636f0-cace-426a-a81b-1dfb036867fc service nova] Enqueued Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGHEST for action security_group_rules [ 1036.960131] env[62620]: INFO networking_nsxv3.common.synchronization [req-3c6ffc6e-569b-4693-bf7f-a3fc811b2ec9 req-615636f0-cace-426a-a81b-1dfb036867fc service nova] Enqueued Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGHEST for action security_group_members [ 1036.960131] env[62620]: INFO networking_nsxv3.common.synchronization [req-3c6ffc6e-569b-4693-bf7f-a3fc811b2ec9 req-615636f0-cace-426a-a81b-1dfb036867fc service nova] Enqueued Resource ID: 3597f9e3-4248-4b24-b7ca-bce13900128a with Priority: HIGHEST for action port [ 1036.960131] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGHEST for action security_group_rules [ 1036.960131] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGHEST for action security_group_members [ 1036.960131] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3597f9e3-4248-4b24-b7ca-bce13900128a with Priority: HIGHEST for action port [ 1036.961587] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94560eb7-1f11-45b3-b778-974dbd9c0094 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.961892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.962126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.962519] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.962753] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94560eb7-1f11-45b3-b778-974dbd9c0094',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.963989] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-94560eb7-1f11-45b3-b778-974dbd9c0094 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.965625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.965625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.965625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.965625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.965625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.965625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.965625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.965625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.965625] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94560eb7-1f11-45b3-b778-974dbd9c0094',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.968160] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-3597f9e3-4248-4b24-b7ca-bce13900128a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.968160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3597f9e3-4248-4b24-b7ca-bce13900128a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.968160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3597f9e3-4248-4b24-b7ca-bce13900128a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.968160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3597f9e3-4248-4b24-b7ca-bce13900128a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.968160] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3597f9e3-4248-4b24-b7ca-bce13900128a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.469560] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-94560eb7-1f11-45b3-b778-974dbd9c0094 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.469683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.469885] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94560eb7-1f11-45b3-b778-974dbd9c0094',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.470931] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3597f9e3-4248-4b24-b7ca-bce13900128a with status ACTIVE [ 1037.471124] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.471236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.471298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.471504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.471592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.471758] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.471852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.471928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.472106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.472183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.472362] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.472453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.472515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.472655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.472759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.472801] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3597f9e3-4248-4b24-b7ca-bce13900128a is going to be updated. [ 1037.492529] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.492654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.492712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.492880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.492999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.493171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3597f9e3-4248-4b24-b7ca-bce13900128a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.643700] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 1037.643892] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 deletion is rescheduled due to dependency. [ 1037.643997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.975023] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94560eb7-1f11-45b3-b778-974dbd9c0094',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.426313] env[62620]: INFO networking_nsxv3.common.synchronization [req-6541966b-79dc-4afd-bf69-1d8ea704bbef req-9f36cf06-97c7-4c86-a7c5-69ed32874a50 tempest-InstanceActionsTestJSON-675212662 tempest-InstanceActionsTestJSON-675212662-project-member] Enqueued Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGHEST for action security_group_members [ 1038.426889] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGHEST for action security_group_members [ 1038.427245] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9920c684-965b-4092-acfe-6862aa2d1cdb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.427371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.427440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.427707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.427878] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.427989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.432138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.432326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.432421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.432519] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9920c684-965b-4092-acfe-6862aa2d1cdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.477691] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.477915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.478029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.478330] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.478463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.478603] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 is going to be created. [ 1038.509049] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.509185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.509267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.509457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.509615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.519048] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 in Status: UNINITIALIZED for 2s [ 1038.935053] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.935210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.935388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.935504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.935618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.935821] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.936965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.936965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.936965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.936965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.936965] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9920c684-965b-4092-acfe-6862aa2d1cdb already deleted. [ 1038.936965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.052374] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.052696] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-676" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.052738] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-676" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.053080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-676" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.053408] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.053589] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.053717] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.053943] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.054110] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.054328] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.054447] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.054566] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.054682] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.054826] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.054950] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.055108] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.073552] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.073725] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.073871] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.074057] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-676" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.074343] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-66cad317-3512-4850-8957-332a2fffb1c0 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.074520] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-66cad317-3512-4850-8957-332a2fffb1c0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.074650] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-66cad317-3512-4850-8957-332a2fffb1c0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.074989] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-66cad317-3512-4850-8957-332a2fffb1c0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.075129] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66cad317-3512-4850-8957-332a2fffb1c0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.577928] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.577928] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.577928] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.577928] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.578209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.578245] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 66cad317-3512-4850-8957-332a2fffb1c0 not found, creating... [ 1039.578513] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.578723] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.578924] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.579127] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.579276] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.579564] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.579747] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.579857] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.580068] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.580210] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.580354] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 66cad317-3512-4850-8957-332a2fffb1c0 is going to be created. [ 1039.600285] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.600479] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.600609] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.600961] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.601207] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.601433] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-66cad317-3512-4850-8957-332a2fffb1c0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.381205] env[62620]: INFO networking_nsxv3.common.synchronization [req-6541966b-79dc-4afd-bf69-1d8ea704bbef req-0c885400-f682-474e-a034-bdaca10052b8 service nova] Enqueued Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGHEST for action security_group_rules [ 1040.381205] env[62620]: INFO networking_nsxv3.common.synchronization [req-6541966b-79dc-4afd-bf69-1d8ea704bbef req-0c885400-f682-474e-a034-bdaca10052b8 service nova] Enqueued Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGHEST for action security_group_members [ 1040.381205] env[62620]: INFO networking_nsxv3.common.synchronization [req-6541966b-79dc-4afd-bf69-1d8ea704bbef req-0c885400-f682-474e-a034-bdaca10052b8 service nova] Enqueued Resource ID: 66cad317-3512-4850-8957-332a2fffb1c0 with Priority: HIGHEST for action port [ 1040.381205] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGHEST for action security_group_rules [ 1040.381205] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGHEST for action security_group_members [ 1040.381205] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66cad317-3512-4850-8957-332a2fffb1c0 with Priority: HIGHEST for action port [ 1040.381205] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9920c684-965b-4092-acfe-6862aa2d1cdb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.381205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.381205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.386227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.386227] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9920c684-965b-4092-acfe-6862aa2d1cdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.386227] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9920c684-965b-4092-acfe-6862aa2d1cdb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.386779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.386779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.386779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.386779] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.386930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.386930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.387345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.387345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.387345] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9920c684-965b-4092-acfe-6862aa2d1cdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.387995] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-66cad317-3512-4850-8957-332a2fffb1c0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.389595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66cad317-3512-4850-8957-332a2fffb1c0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.389595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66cad317-3512-4850-8957-332a2fffb1c0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.389779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66cad317-3512-4850-8957-332a2fffb1c0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.389858] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66cad317-3512-4850-8957-332a2fffb1c0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.528114] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 in Status: SUCCESS [ 1040.528365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.528527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.528754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.528951] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.529085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.529154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.529310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.529390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.529475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.529568] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94560eb7-1f11-45b3-b778-974dbd9c0094',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.892006] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9920c684-965b-4092-acfe-6862aa2d1cdb taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.892172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.892368] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9920c684-965b-4092-acfe-6862aa2d1cdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.893659] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66cad317-3512-4850-8957-332a2fffb1c0 with status ACTIVE [ 1040.893856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.893989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.894070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.894274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.894365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.894535] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.894635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.894701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.894849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.895318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.895318] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.895318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.895318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.895483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.895483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.895617] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66cad317-3512-4850-8957-332a2fffb1c0 is going to be updated. [ 1040.915704] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.915863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.915933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.916078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.916210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.916357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66cad317-3512-4850-8957-332a2fffb1c0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.031689] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-94560eb7-1f11-45b3-b778-974dbd9c0094 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.031856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.031931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.032167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.032335] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.032437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.032504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.032651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.032739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.032826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.032970] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-94560eb7-1f11-45b3-b778-974dbd9c0094 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.033074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.033134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.033274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.033408] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.033521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.033588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.033732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.033808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.033889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.033994] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94560eb7-1f11-45b3-b778-974dbd9c0094',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.397530] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9920c684-965b-4092-acfe-6862aa2d1cdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.535709] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94560eb7-1f11-45b3-b778-974dbd9c0094: rpc.has_security_group_logging(os_id): False [ 1041.552855] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.552996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.553088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.553302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.553393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.553579] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.553678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.553742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.553886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.553962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.554182] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.554675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.554675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.554675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.554675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.554848] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.554848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.554848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.554989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.555075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.555160] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 is going to be created. [ 1041.629413] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.629550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.629615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.629851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.630047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.639391] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 in Status: IN_PROGRESS for 2s [ 1041.899828] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.899991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.900080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.900299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.900405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.900504] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9920c684-965b-4092-acfe-6862aa2d1cdb is going to be created. [ 1041.926030] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.926030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.926030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.926030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.926030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.935194] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9920c684-965b-4092-acfe-6862aa2d1cdb in Status: UNINITIALIZED for 2s [ 1043.650693] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 in Status: SUCCESS [ 1043.650996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.946056] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9920c684-965b-4092-acfe-6862aa2d1cdb in Status: SUCCESS [ 1043.946344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.946434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.946660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.946851] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.946967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.947045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.947205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.947281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.947368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.947460] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9920c684-965b-4092-acfe-6862aa2d1cdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.292109] env[62620]: INFO networking_nsxv3.common.synchronization [req-52572737-81ea-40df-90fa-33ed60661748 req-3de9b4db-d522-4d72-a141-b6ef7dc782b4 tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1044.292109] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1044.292109] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.292109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.292109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.292986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.293296] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.293527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.293689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.293940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.294144] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.294323] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.453547] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9920c684-965b-4092-acfe-6862aa2d1cdb taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.453547] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.453547] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9920c684-965b-4092-acfe-6862aa2d1cdb taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.453547] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.453547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.454164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.454164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.454164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.454164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.454164] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9920c684-965b-4092-acfe-6862aa2d1cdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.595597] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.595844] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.596066] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.596345] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.596659] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.597429] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.597429] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.597429] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.597429] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.597599] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.597660] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.597761] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.597874] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.597989] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.598383] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.598383] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.617454] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.617645] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.617802] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.618013] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-895" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.618401] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-08a5a113-46c4-4d22-b644-b503cfb32646 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.618593] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-08a5a113-46c4-4d22-b644-b503cfb32646" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.618725] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-08a5a113-46c4-4d22-b644-b503cfb32646" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.619068] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-08a5a113-46c4-4d22-b644-b503cfb32646" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.619230] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08a5a113-46c4-4d22-b644-b503cfb32646',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.797147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.797473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.797473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.797610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.797731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.797947] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.798086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.798141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.798747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.798747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.798747] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 1044.823657] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.823657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.823657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.823909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.823968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.831712] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 1044.956331] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9920c684-965b-4092-acfe-6862aa2d1cdb: rpc.has_security_group_logging(os_id): False [ 1044.973591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.973718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.973770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.973975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.974087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.974315] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.974395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.974458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.974610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.974689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.974860] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.974949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.975232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.975232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.975232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.975409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.975502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.975578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.975789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.975869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.975954] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9920c684-965b-4092-acfe-6862aa2d1cdb is going to be created. [ 1045.027631] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.027804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.027842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.028079] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.028266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.037665] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9920c684-965b-4092-acfe-6862aa2d1cdb in Status: IN_PROGRESS for 2s [ 1045.124999] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.125329] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.125489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.125881] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.126070] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.126268] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 08a5a113-46c4-4d22-b644-b503cfb32646 not found, creating... [ 1045.126587] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.126832] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.126962] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.127207] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.127356] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.127644] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.127804] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.127927] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.128224] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.128430] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.128890] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 08a5a113-46c4-4d22-b644-b503cfb32646 is going to be created. [ 1045.161960] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.162172] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.162302] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.162586] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.162766] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.162985] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-08a5a113-46c4-4d22-b644-b503cfb32646" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.935357] env[62620]: INFO networking_nsxv3.common.synchronization [req-52572737-81ea-40df-90fa-33ed60661748 req-0ccc51a7-a7b4-4645-a641-3991d341956d service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 1045.935682] env[62620]: INFO networking_nsxv3.common.synchronization [req-52572737-81ea-40df-90fa-33ed60661748 req-0ccc51a7-a7b4-4645-a641-3991d341956d service nova] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1045.936077] env[62620]: INFO networking_nsxv3.common.synchronization [req-52572737-81ea-40df-90fa-33ed60661748 req-0ccc51a7-a7b4-4645-a641-3991d341956d service nova] Enqueued Resource ID: 08a5a113-46c4-4d22-b644-b503cfb32646 with Priority: HIGHEST for action port [ 1045.936302] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_rules [ 1045.936440] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1045.936541] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08a5a113-46c4-4d22-b644-b503cfb32646 with Priority: HIGHEST for action port [ 1045.937411] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.938023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.938023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.938312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.938362] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.939843] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.940074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.940448] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-08a5a113-46c4-4d22-b644-b503cfb32646 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.940586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08a5a113-46c4-4d22-b644-b503cfb32646" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.940674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08a5a113-46c4-4d22-b644-b503cfb32646" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.940884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08a5a113-46c4-4d22-b644-b503cfb32646" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.940984] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08a5a113-46c4-4d22-b644-b503cfb32646',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.442733] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08a5a113-46c4-4d22-b644-b503cfb32646 with status ACTIVE [ 1046.443025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.443143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.443215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.443460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.443566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.443746] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.443850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.443941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.444078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.444206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.444336] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.444447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.444478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.444619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.444692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.444776] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08a5a113-46c4-4d22-b644-b503cfb32646 is going to be updated. [ 1046.446042] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.446147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.464812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.464812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.464928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.465073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.465188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.465345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08a5a113-46c4-4d22-b644-b503cfb32646" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.680163] env[62620]: INFO networking_nsxv3.common.synchronization [req-c11fef4d-97b6-4f48-a1d5-0e1baf361d61 req-fa5027b7-c01d-494c-92ad-6ace9eaa9ffa tempest-ServersTestFqdnHostnames-27247144 tempest-ServersTestFqdnHostnames-27247144-project-member] Enqueued Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_members [ 1046.680163] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_members [ 1046.680163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84fabf93-4432-40c4-890b-0bf1580dbb93 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.680501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.680720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.681104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.681391] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.681632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.681848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.682137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.682857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.683094] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.842295] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 1046.842295] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 deletion is rescheduled due to dependency. [ 1046.842295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.842295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.842295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.842466] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.842523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.842702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.842763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.843565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.843565] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.048857] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9920c684-965b-4092-acfe-6862aa2d1cdb in Status: SUCCESS [ 1047.049240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.185915] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.186174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.186246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.186483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.186572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.186784] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.186883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.186947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.187127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.187237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.187285] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 already deleted. [ 1047.187371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.315565] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-673 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.315860] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-673" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.316020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-673" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.316413] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-673" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.316762] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.318059] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.318059] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.318059] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.318059] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.318059] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.318059] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.318059] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.318059] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.318522] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.318522] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.318522] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.338106] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.338301] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1047.338459] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.338649] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-673" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.338970] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-861a18bd-3c64-44b6-9e6b-a78d9449b584 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.339179] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-861a18bd-3c64-44b6-9e6b-a78d9449b584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.339315] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-861a18bd-3c64-44b6-9e6b-a78d9449b584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.339669] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-861a18bd-3c64-44b6-9e6b-a78d9449b584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.339823] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('861a18bd-3c64-44b6-9e6b-a78d9449b584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.345426] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.842532] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.843058] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.843058] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.843241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.843412] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.843722] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 861a18bd-3c64-44b6-9e6b-a78d9449b584 not found, creating... [ 1047.843904] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.844095] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.844224] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.844536] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.844687] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.844979] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.845152] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.845274] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.845878] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.845878] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.845878] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 861a18bd-3c64-44b6-9e6b-a78d9449b584 is going to be created. [ 1047.846965] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.866618] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.866618] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.866618] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.866820] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.866973] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.867293] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-861a18bd-3c64-44b6-9e6b-a78d9449b584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.127783] env[62620]: INFO networking_nsxv3.common.synchronization [req-8c1f4bcb-f9da-4eaf-a217-0537023ff0c9 req-41d996f8-fc79-436a-b1e5-c25e3d4d03a1 tempest-TenantUsagesTestJSON-1395357459 tempest-TenantUsagesTestJSON-1395357459-project-member] Enqueued Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGHEST for action security_group_members [ 1048.128440] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGHEST for action security_group_members [ 1048.128959] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-94560eb7-1f11-45b3-b778-974dbd9c0094 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.128959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.128959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.129274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.129435] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.129600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.129777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.130192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.130192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.130328] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94560eb7-1f11-45b3-b778-974dbd9c0094',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.350178] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.350322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.350391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.351366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.351366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.351366] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 1048.379190] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.379353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.379421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.379631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.380262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.387195] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 1048.632454] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.632605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.632675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.632877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.632975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.633193] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.633303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.633369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.633503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.633742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.633926] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 is going to be updated. [ 1048.664163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.664330] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.664580] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.664580] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.664711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.673855] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 in Status: IN_PROGRESS for 2s [ 1048.735375] env[62620]: INFO networking_nsxv3.common.synchronization [req-c11fef4d-97b6-4f48-a1d5-0e1baf361d61 req-bde3cf33-0409-4200-bd91-b723cc1ce887 service nova] Enqueued Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_rules [ 1048.735565] env[62620]: INFO networking_nsxv3.common.synchronization [req-c11fef4d-97b6-4f48-a1d5-0e1baf361d61 req-bde3cf33-0409-4200-bd91-b723cc1ce887 service nova] Enqueued Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_members [ 1048.735920] env[62620]: INFO networking_nsxv3.common.synchronization [req-c11fef4d-97b6-4f48-a1d5-0e1baf361d61 req-bde3cf33-0409-4200-bd91-b723cc1ce887 service nova] Enqueued Resource ID: 861a18bd-3c64-44b6-9e6b-a78d9449b584 with Priority: HIGHEST for action port [ 1048.736437] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_rules [ 1048.736574] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_members [ 1048.736687] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 861a18bd-3c64-44b6-9e6b-a78d9449b584 with Priority: HIGHEST for action port [ 1048.737012] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84fabf93-4432-40c4-890b-0bf1580dbb93 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.737795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.737872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.738093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.738179] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.738972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84fabf93-4432-40c4-890b-0bf1580dbb93 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.739106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.739175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.739344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.739550] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.739615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.739650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.739770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.739854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.739938] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.740668] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-861a18bd-3c64-44b6-9e6b-a78d9449b584 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.740959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-861a18bd-3c64-44b6-9e6b-a78d9449b584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.740959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-861a18bd-3c64-44b6-9e6b-a78d9449b584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.740959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-861a18bd-3c64-44b6-9e6b-a78d9449b584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.741066] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('861a18bd-3c64-44b6-9e6b-a78d9449b584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.242579] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84fabf93-4432-40c4-890b-0bf1580dbb93 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.242966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.243038] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.243958] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 861a18bd-3c64-44b6-9e6b-a78d9449b584 with status ACTIVE [ 1049.244176] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.244307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.244372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.244601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.244715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.244913] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.245026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.245095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.245277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.245383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.245597] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.245761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.245843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.246015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.246114] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.246207] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 861a18bd-3c64-44b6-9e6b-a78d9449b584 is going to be updated. [ 1049.270387] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.270610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.270646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.270858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.271048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.271259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-861a18bd-3c64-44b6-9e6b-a78d9449b584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.749275] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.253177] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.253177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.253177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.253177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.253177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.253177] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 is going to be created. [ 1050.275302] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.275458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.275515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.275762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.275928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.283862] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 in Status: UNINITIALIZED for 2s [ 1050.397913] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 1050.398191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.398360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.398567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.398784] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.398869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.398934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.399112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.399905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.399905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.399905] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.684551] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 in Status: SUCCESS [ 1050.684551] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 deletion is rescheduled due to dependency. [ 1050.684551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.901143] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.901271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.901361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.901999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.901999] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.901999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.901999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.902236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.902236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.902335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.902528] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.902639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.902725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.902885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.903070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.903224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.903298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.903482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.903593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.903663] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.903754] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.405564] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c995751-5151-4812-a1e5-510ea09222e0: rpc.has_security_group_logging(os_id): False [ 1051.423126] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.423277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.423349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.423561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.423682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.423900] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.424018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.424084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.424247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.424324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.424506] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.424601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.424663] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.424804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.424877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.425084] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.425178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.425239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.425376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.425451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.425536] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 1051.488710] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.488859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.488932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.489175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.489326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.502787] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 1052.298131] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 in Status: SUCCESS [ 1052.298131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.298131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.298131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.298131] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.298131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.298131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.298131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.298131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.298131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.298131] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.416303] env[62620]: INFO networking_nsxv3.common.synchronization [req-8dd7e758-c587-4b7f-bd35-0248787568bd req-ef9884c6-c97f-4769-8748-c7304d93760a tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1052.416910] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1052.417142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.417267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.417334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.417534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.417691] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.417789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.417853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.422019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.422019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.422019] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.804645] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.920715] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.921304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.921419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.921636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.921722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.922047] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.922047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.922225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.922264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.922327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.922415] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1052.947910] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.948038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.948117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.948371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.948483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.957486] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1053.307046] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84fabf93-4432-40c4-890b-0bf1580dbb93: rpc.has_security_group_logging(os_id): False [ 1053.326286] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.326485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.326485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.326704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.326801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.327060] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.327169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.327232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.327383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.327459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.327543] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 is going to be created. [ 1053.386754] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.386925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.386976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.387320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.387539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.399069] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 in Status: IN_PROGRESS for 2s [ 1053.518536] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 1053.518909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.112081] env[62620]: INFO networking_nsxv3.common.synchronization [req-076d20f7-9ec1-40dc-850d-80266e1e9a88 req-514a4525-eca3-457b-b3bd-69a201402556 tempest-ListServerFiltersTestJSON-1687006819 tempest-ListServerFiltersTestJSON-1687006819-project-member] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1054.112629] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1054.112937] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.113073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.113144] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.113416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.113576] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.113682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.113749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.113905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.113992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.114097] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.397832] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.398044] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.398209] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.399062] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.399062] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.399191] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.399234] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.399421] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.399565] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.399767] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.400427] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.400427] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.400427] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.400427] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.400427] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.400619] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.417420] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.417420] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1054.417420] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.418577] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.418577] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.418577] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.418577] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.418577] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.418836] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e993a7b-e7ba-4beb-ac82-cd2f2b111371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.616037] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.616435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.616435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.616538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.616591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.616936] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.617056] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.617119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.617330] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.617422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.617542] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 already deleted. [ 1054.617644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.922618] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.922878] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.922984] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.923317] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.923479] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.923649] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 6e993a7b-e7ba-4beb-ac82-cd2f2b111371 not found, creating... [ 1054.923929] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.924105] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.924233] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.924469] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.924609] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.925017] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.925531] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.925804] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.926184] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.926442] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.926690] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 6e993a7b-e7ba-4beb-ac82-cd2f2b111371 is going to be created. [ 1054.946683] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.946952] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.947138] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.947424] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.947699] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.947943] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.968794] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1054.968923] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 1054.969066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.409476] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 in Status: SUCCESS [ 1055.409691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.707470] env[62620]: INFO networking_nsxv3.common.synchronization [req-076d20f7-9ec1-40dc-850d-80266e1e9a88 req-8598b204-5ded-4288-99eb-be2b379e110f service nova] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_rules [ 1055.707470] env[62620]: INFO networking_nsxv3.common.synchronization [req-076d20f7-9ec1-40dc-850d-80266e1e9a88 req-8598b204-5ded-4288-99eb-be2b379e110f service nova] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1055.707470] env[62620]: INFO networking_nsxv3.common.synchronization [req-076d20f7-9ec1-40dc-850d-80266e1e9a88 req-8598b204-5ded-4288-99eb-be2b379e110f service nova] Enqueued Resource ID: 6e993a7b-e7ba-4beb-ac82-cd2f2b111371 with Priority: HIGHEST for action port [ 1055.708080] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_rules [ 1055.708080] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1055.708080] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e993a7b-e7ba-4beb-ac82-cd2f2b111371 with Priority: HIGHEST for action port [ 1055.708454] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.708577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.708642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.708905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.708998] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.711335] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.711449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.711516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.711689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.711838] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.711930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.711986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.712374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.712374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.712374] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.717292] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.717292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.717292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.717292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.717292] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e993a7b-e7ba-4beb-ac82-cd2f2b111371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.216302] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.216302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.216563] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.219710] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e993a7b-e7ba-4beb-ac82-cd2f2b111371 with status ACTIVE [ 1056.219710] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.219710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.219710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.220053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.220301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.220427] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.220518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.220582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.220760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.220853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.221016] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.221115] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.221181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.221323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.221387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.221475] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e993a7b-e7ba-4beb-ac82-cd2f2b111371 is going to be updated. [ 1056.241230] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.241509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.241509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.241686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.241774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.241932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e993a7b-e7ba-4beb-ac82-cd2f2b111371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.718337] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.720959] env[62620]: INFO networking_nsxv3.common.synchronization [req-14386c65-ed36-408b-9f8e-0907dfa46aaa req-4eefb786-9267-4dfa-9e9d-a676a8b2297c tempest-ListServerFiltersTestJSON-1687006819 tempest-ListServerFiltersTestJSON-1687006819-project-member] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1056.723290] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1056.723690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.723798] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.204250] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.204250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.204250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.204554] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.204812] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.205021] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.205154] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.205380] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.205538] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.205765] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1057.205909] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.206046] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.206162] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.206283] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1057.206399] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.206541] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.223359] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.223751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.223904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.224065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.224161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.224260] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be created. [ 1057.226131] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.226530] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1057.226530] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.226606] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.227042] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.227260] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.227427] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.227765] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.227923] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.252551] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.252551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.252551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.252551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.252809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.261710] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: UNINITIALIZED for 2s [ 1057.730628] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.730993] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.730993] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.731331] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.731496] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.731676] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f not found, creating... [ 1057.731956] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.732157] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.732299] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.732547] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.732694] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.732984] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.733163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.733289] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.733504] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.733646] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.733826] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f is going to be created. [ 1057.754632] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.754843] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.754971] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.755253] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.755483] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.755728] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.834419] env[62620]: INFO networking_nsxv3.common.synchronization [req-ac005499-9a90-4f39-a221-040b29afc0d4 req-517963a0-9fa3-4b9a-b9c7-e2c02a142657 tempest-InstanceActionsTestJSON-675212662 tempest-InstanceActionsTestJSON-675212662-project-member] Enqueued Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGHEST for action security_group_members [ 1057.834419] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGHEST for action security_group_members [ 1057.834605] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9920c684-965b-4092-acfe-6862aa2d1cdb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.834676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.834781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.835013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.835182] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.835286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.835360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.835512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.835608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.835697] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9920c684-965b-4092-acfe-6862aa2d1cdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.337827] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.338047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.338111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.338350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.338444] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.338636] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.338739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.338817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.338958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.339045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.339132] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9920c684-965b-4092-acfe-6862aa2d1cdb is going to be updated. [ 1058.364417] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.364656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.365489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.365734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.366055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.374986] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9920c684-965b-4092-acfe-6862aa2d1cdb in Status: IN_PROGRESS for 2s [ 1058.602406] env[62620]: INFO networking_nsxv3.common.synchronization [req-14386c65-ed36-408b-9f8e-0907dfa46aaa req-1d49a783-3849-4791-b48e-33cea4d38e70 service nova] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_rules [ 1058.602600] env[62620]: INFO networking_nsxv3.common.synchronization [req-14386c65-ed36-408b-9f8e-0907dfa46aaa req-1d49a783-3849-4791-b48e-33cea4d38e70 service nova] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1058.602745] env[62620]: INFO networking_nsxv3.common.synchronization [req-14386c65-ed36-408b-9f8e-0907dfa46aaa req-1d49a783-3849-4791-b48e-33cea4d38e70 service nova] Enqueued Resource ID: 1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f with Priority: HIGHEST for action port [ 1058.602999] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_rules [ 1058.603144] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1058.603243] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f with Priority: HIGHEST for action port [ 1058.603795] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.603904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.604288] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.604531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.604611] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.604683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.604979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.604979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.605109] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.898701] env[62620]: INFO networking_nsxv3.common.synchronization [req-8edda547-9616-42a4-81e5-2a1eb35e4c72 req-480da1b2-62a6-4e3f-8cca-f4a4aaf32a6e tempest-ListServerFiltersTestJSON-1687006819 tempest-ListServerFiltersTestJSON-1687006819-project-member] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1058.899235] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1058.899539] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.899660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.107260] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f with status ACTIVE [ 1059.107542] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.107675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.107733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.107954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.108069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.108511] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.108511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.108709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.108785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.108869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.109070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.109169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.109242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.109370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.109444] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.109529] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f is going to be updated. [ 1059.131336] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.131518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.131630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.131766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.131905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.132068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a7a45f5-84e1-4b69-add9-e5b1fe8fd92f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.281474] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1059.281711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.281893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.282128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.282313] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.282437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.282506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.282659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.282739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.282825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.282928] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.283830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.283961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.284140] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.284245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.284308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.284450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.284529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.284612] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.320710] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.320922] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.321074] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.321363] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.321629] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.321791] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.321914] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.322166] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.322335] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.322525] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.322643] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.322756] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.322868] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.322982] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.323108] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.323244] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.357046] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.357487] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1059.357644] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.357832] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-683" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.358174] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-7a1d4f75-d881-4698-995b-8545c20494e7 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.358346] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-7a1d4f75-d881-4698-995b-8545c20494e7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.358473] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-7a1d4f75-d881-4698-995b-8545c20494e7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.359427] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-7a1d4f75-d881-4698-995b-8545c20494e7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.359582] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a1d4f75-d881-4698-995b-8545c20494e7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.786769] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.786903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.787158] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.862527] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.862757] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.862886] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.863232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.863384] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.863539] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 7a1d4f75-d881-4698-995b-8545c20494e7 not found, creating... [ 1059.863809] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.863967] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.864102] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.864345] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.864484] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.864770] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.864987] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.865120] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.865483] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.865483] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.865596] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 7a1d4f75-d881-4698-995b-8545c20494e7 is going to be created. [ 1059.888153] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.888153] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.888153] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.888153] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.888153] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.888153] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-7a1d4f75-d881-4698-995b-8545c20494e7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.290292] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.384968] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9920c684-965b-4092-acfe-6862aa2d1cdb in Status: SUCCESS [ 1060.385180] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9920c684-965b-4092-acfe-6862aa2d1cdb deletion is rescheduled due to dependency. [ 1060.385295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.789629] env[62620]: INFO networking_nsxv3.common.synchronization [req-8edda547-9616-42a4-81e5-2a1eb35e4c72 req-ba1930f4-2055-45cd-b4a8-cf9e69f60b92 service nova] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_rules [ 1060.789833] env[62620]: INFO networking_nsxv3.common.synchronization [req-8edda547-9616-42a4-81e5-2a1eb35e4c72 req-ba1930f4-2055-45cd-b4a8-cf9e69f60b92 service nova] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1060.789978] env[62620]: INFO networking_nsxv3.common.synchronization [req-8edda547-9616-42a4-81e5-2a1eb35e4c72 req-ba1930f4-2055-45cd-b4a8-cf9e69f60b92 service nova] Enqueued Resource ID: 7a1d4f75-d881-4698-995b-8545c20494e7 with Priority: HIGHEST for action port [ 1060.790226] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_rules [ 1060.790356] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1060.790453] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a1d4f75-d881-4698-995b-8545c20494e7 with Priority: HIGHEST for action port [ 1060.791054] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.791190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.791365] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.791449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.791625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a1d4f75-d881-4698-995b-8545c20494e7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.791722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a1d4f75-d881-4698-995b-8545c20494e7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.791785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a1d4f75-d881-4698-995b-8545c20494e7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.792006] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a1d4f75-d881-4698-995b-8545c20494e7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.792097] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a1d4f75-d881-4698-995b-8545c20494e7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.792978] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.793097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.793165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.793327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.793434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.793526] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be updated. [ 1060.821716] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.821876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.821926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.822367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.822367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.830345] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1061.296025] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a1d4f75-d881-4698-995b-8545c20494e7 with status ACTIVE [ 1061.296447] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.296447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.296553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.296726] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.296797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.296968] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.297082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.297147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.297299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.297377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.297561] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.297654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.297711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.297851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.297925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.298039] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a1d4f75-d881-4698-995b-8545c20494e7 is going to be updated. [ 1061.318868] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.319011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.319119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.319339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.319494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.319663] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a1d4f75-d881-4698-995b-8545c20494e7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.840411] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1062.840660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.840781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.841019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.841205] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.841327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.841431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.841625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.841710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.841807] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.344212] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.846375] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.132923] env[62620]: INFO networking_nsxv3.common.synchronization [req-550d9d6b-be14-4624-9114-6745a8738be6 req-aa482a7f-1b56-4ffd-80ad-5d4100042a61 tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1064.133742] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1064.134175] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.134354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.134451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.134731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.134957] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.135240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.135240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.135413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.135542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.135682] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.348438] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.348586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.348656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.349134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.349134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.349134] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be updated. [ 1064.375832] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.376081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.376151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.376363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.376511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.385224] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1064.533814] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.534173] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.534376] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.534776] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.535190] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.535431] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.536323] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.536323] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.536323] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.536490] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.536677] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.536884] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.537084] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.537275] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.537451] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.537659] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.555923] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.556261] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.556373] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.556487] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.556808] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-8170eace-a3a9-4b61-8d61-10d08aa65847 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.557075] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-8170eace-a3a9-4b61-8d61-10d08aa65847" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.557228] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-8170eace-a3a9-4b61-8d61-10d08aa65847" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.557561] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-8170eace-a3a9-4b61-8d61-10d08aa65847" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.557711] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8170eace-a3a9-4b61-8d61-10d08aa65847',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.638607] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.638765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.638837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.639082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.639180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.639393] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.639670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.639722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.639889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.640053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.640138] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1064.666363] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.666363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.666363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.666615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.666783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.675315] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1065.060462] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.060830] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.060877] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.061212] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.061374] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.061541] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 8170eace-a3a9-4b61-8d61-10d08aa65847 not found, creating... [ 1065.061814] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.061983] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.062133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.062366] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.062514] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.062804] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.062967] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.063107] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.063337] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.063469] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.063650] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 8170eace-a3a9-4b61-8d61-10d08aa65847 is going to be created. [ 1065.084521] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.084679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.084725] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.085035] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.085308] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.085590] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-8170eace-a3a9-4b61-8d61-10d08aa65847" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.260022] env[62620]: INFO networking_nsxv3.common.synchronization [req-d524044e-d080-4f77-bf4d-2445d726bf84 req-34546974-6bf5-4bf5-b1f8-aec87b78d589 tempest-ImagesTestJSON-765150101 tempest-ImagesTestJSON-765150101-project-member] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1065.260022] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGHEST for action security_group_members [ 1065.260022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.260022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.260022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.260022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.260022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.260022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.261106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.261379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.261520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.261660] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.764513] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.764694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.764923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.765051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.765051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.765250] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.765349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.765410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.765558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.765628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.765712] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be updated. [ 1065.790805] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.791020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.791020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.791232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.791381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.800434] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: IN_PROGRESS for 2s [ 1065.823718] env[62620]: INFO networking_nsxv3.common.synchronization [req-550d9d6b-be14-4624-9114-6745a8738be6 req-c4afee50-5795-436f-977a-663ca3afc42e service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 1065.823911] env[62620]: INFO networking_nsxv3.common.synchronization [req-550d9d6b-be14-4624-9114-6745a8738be6 req-c4afee50-5795-436f-977a-663ca3afc42e service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1065.824124] env[62620]: INFO networking_nsxv3.common.synchronization [req-550d9d6b-be14-4624-9114-6745a8738be6 req-c4afee50-5795-436f-977a-663ca3afc42e service nova] Enqueued Resource ID: 8170eace-a3a9-4b61-8d61-10d08aa65847 with Priority: HIGHEST for action port [ 1065.824364] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 1065.824497] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1065.824596] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8170eace-a3a9-4b61-8d61-10d08aa65847 with Priority: HIGHEST for action port [ 1065.826494] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.826494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.826494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.826494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.826494] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.827041] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.827041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.827184] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8170eace-a3a9-4b61-8d61-10d08aa65847 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.827618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8170eace-a3a9-4b61-8d61-10d08aa65847" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.827618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8170eace-a3a9-4b61-8d61-10d08aa65847" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.827618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8170eace-a3a9-4b61-8d61-10d08aa65847" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.827618] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8170eace-a3a9-4b61-8d61-10d08aa65847',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.329834] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.329834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.330201] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8170eace-a3a9-4b61-8d61-10d08aa65847 with status ACTIVE [ 1066.330201] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.330201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.330307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.330562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.330602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.331238] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.331238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.331238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.331238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.331238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.332374] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.332374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.332374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.332374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.332374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.332374] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8170eace-a3a9-4b61-8d61-10d08aa65847 is going to be updated. [ 1066.353029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.353029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.353029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.353029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.353029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.353558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8170eace-a3a9-4b61-8d61-10d08aa65847" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.393773] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1066.394247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.394310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.394484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.394672] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.395250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.395250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.395250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.395250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.395250] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.548233] env[62620]: INFO networking_nsxv3.common.synchronization [req-d53390a5-f5e1-45f7-bab1-a000465b0ab6 req-8be4c010-5a8a-498b-a721-afe25ac41ca1 tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1066.551436] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1066.551436] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.551436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.551436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.551436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.551436] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.551436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.551436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.551436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.551436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.551436] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.684166] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1066.684347] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 1066.684524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.684708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.685106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.685737] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.685737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.685737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.685975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.686030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.686123] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.896839] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.037036] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.037295] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.037427] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.037699] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.037969] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.041957] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.041957] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.041957] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.041957] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.041957] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.041957] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.041957] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.041957] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.041957] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.041957] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.041957] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.053294] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.053418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.053509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.053671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.053759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.053957] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.054126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.054126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.054997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.054997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.054997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3921e17-5705-42fe-988b-f0c37340437f already deleted. [ 1067.054997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.060494] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.060663] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1067.060810] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.060990] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.061298] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.061468] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.061596] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.061894] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.062053] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c77ae6ec-d1ea-4f56-b856-910a5835bc0d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.188366] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.399461] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.565679] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.565679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.565679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.565679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.565679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.565679] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port c77ae6ec-d1ea-4f56-b856-910a5835bc0d not found, creating... [ 1067.565679] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.565679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.565679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.565679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.565679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.566211] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.567033] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.567033] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.567033] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.567033] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.567193] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: c77ae6ec-d1ea-4f56-b856-910a5835bc0d is going to be created. [ 1067.587450] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.587655] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.587783] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.588117] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.588372] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.588599] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.690806] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.870246] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c995751-5151-4812-a1e5-510ea09222e0 in Status: SUCCESS [ 1067.870415] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 deletion is rescheduled due to dependency. [ 1067.870528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.901867] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.902059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.902059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.902233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.902320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.902417] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be updated. [ 1067.931540] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.931723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.931762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.931961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.932116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.940667] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1068.193261] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.193453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.193541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.193789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.193911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.194051] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1068.226472] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.226631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.226705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.226929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.227104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.236540] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1068.811255] env[62620]: INFO networking_nsxv3.common.synchronization [req-d53390a5-f5e1-45f7-bab1-a000465b0ab6 req-11d0e796-b48e-4744-984d-ab9e08bfc2c1 service nova] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_rules [ 1068.811547] env[62620]: INFO networking_nsxv3.common.synchronization [req-d53390a5-f5e1-45f7-bab1-a000465b0ab6 req-11d0e796-b48e-4744-984d-ab9e08bfc2c1 service nova] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1068.811837] env[62620]: INFO networking_nsxv3.common.synchronization [req-d53390a5-f5e1-45f7-bab1-a000465b0ab6 req-11d0e796-b48e-4744-984d-ab9e08bfc2c1 service nova] Enqueued Resource ID: c77ae6ec-d1ea-4f56-b856-910a5835bc0d with Priority: HIGHEST for action port [ 1068.811896] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_rules [ 1068.812018] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1068.812134] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77ae6ec-d1ea-4f56-b856-910a5835bc0d with Priority: HIGHEST for action port [ 1068.812857] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.812857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.812975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.813308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.817042] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.818259] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.818444] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.818518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.818702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.818882] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.818984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.819084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.819205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.819286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.819375] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.823020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.823020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.823020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.823020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.823020] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c77ae6ec-d1ea-4f56-b856-910a5835bc0d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.261637] env[62620]: INFO networking_nsxv3.common.synchronization [None req-f3c5ff1b-4ae4-44c8-b560-3839dbc62971 None None] Enqueued Resource ID: 0391a02f-cd61-4774-9e17-0b418887ef37 with Priority: HIGHEST for action port [ 1069.261868] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0391a02f-cd61-4774-9e17-0b418887ef37 with Priority: HIGHEST for action port [ 1069.262188] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-0391a02f-cd61-4774-9e17-0b418887ef37 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.262299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0391a02f-cd61-4774-9e17-0b418887ef37" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.262364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0391a02f-cd61-4774-9e17-0b418887ef37" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.262618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0391a02f-cd61-4774-9e17-0b418887ef37" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.262718] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0391a02f-cd61-4774-9e17-0b418887ef37',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.321886] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.322074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.324704] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.324704] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c77ae6ec-d1ea-4f56-b856-910a5835bc0d with status ACTIVE [ 1069.324843] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.325023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.325164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.325428] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.325524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.325708] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.325807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.325870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.326114] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.326236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.326496] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.326642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.326733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.326912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.326989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.327171] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c77ae6ec-d1ea-4f56-b856-910a5835bc0d is going to be updated. [ 1069.350172] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.350343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.350414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.350623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.350757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.350918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c77ae6ec-d1ea-4f56-b856-910a5835bc0d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.764733] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0391a02f-cd61-4774-9e17-0b418887ef37 [ 1069.764905] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.765036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.765110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.765340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.765389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.765460] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0391a02f-cd61-4774-9e17-0b418887ef37 already deleted. [ 1069.765554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0391a02f-cd61-4774-9e17-0b418887ef37" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.829822] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.950483] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1069.950723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.950940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.951164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.951355] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.951486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.951590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.951701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.951779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.951861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.952055] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.952142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.952201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.952554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.952554] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.952554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.952760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.952760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.952814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.952895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.952970] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.955675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.955866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.956027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.956104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.956202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.956359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.956405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.956494] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.248696] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1070.248696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.248696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.248696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.248696] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.248696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.248696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.248696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.248696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.248696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.248696] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.336475] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.336673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.336743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.337083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.337135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.337533] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3921e17-5705-42fe-988b-f0c37340437f is going to be created. [ 1070.360575] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.360773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.360848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.361077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.361279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.371536] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: UNINITIALIZED for 2s [ 1070.458516] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5: rpc.has_security_group_logging(os_id): False [ 1070.461891] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.479022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.479022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.479022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.479022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.479759] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.479759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.479759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.479759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.479759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.479759] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be created. [ 1070.546591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.546744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.546859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.547073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.547254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.557760] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1070.750575] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.750807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.750912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.751185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.751411] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.751567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.751652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.751876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.752066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.752165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.752373] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.752513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.752601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.752828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.753824] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.754089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.754255] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.754505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.754702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.754961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.755057] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.963632] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.238822] env[62620]: INFO networking_nsxv3.common.synchronization [None req-9f1fa2d5-03e6-4551-9b52-e37a3988697b None None] Enqueued Resource ID: 96e19974-879b-49a2-a3e5-284818d1fd3c with Priority: HIGHEST for action port [ 1071.240495] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96e19974-879b-49a2-a3e5-284818d1fd3c with Priority: HIGHEST for action port [ 1071.240850] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-96e19974-879b-49a2-a3e5-284818d1fd3c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.242336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96e19974-879b-49a2-a3e5-284818d1fd3c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.243091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96e19974-879b-49a2-a3e5-284818d1fd3c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.243091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96e19974-879b-49a2-a3e5-284818d1fd3c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.243091] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96e19974-879b-49a2-a3e5-284818d1fd3c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.259250] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c469d6d-346a-40a2-adb5-8c50f7758224: rpc.has_security_group_logging(os_id): False [ 1071.280426] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.281549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.281549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.281549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.281549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.281549] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.281549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.281549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.282417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.282417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.282417] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.282586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.282586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.282771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.283057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.283296] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.283433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.283523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.283697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.284332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.284895] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1071.355815] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.356134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.356134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.356325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.356455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.370207] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1071.466546] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.466891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.466891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.470323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.470390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.470506] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be updated. [ 1071.503487] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.503868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.503868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.504020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.504090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.517114] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1071.750665] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96e19974-879b-49a2-a3e5-284818d1fd3c [ 1071.750900] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.751040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.751113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.751331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.751420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.752032] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96e19974-879b-49a2-a3e5-284818d1fd3c already deleted. [ 1071.752032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96e19974-879b-49a2-a3e5-284818d1fd3c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.381147] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: SUCCESS [ 1072.381439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.381562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.381785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.381972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.382139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.382204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.382369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.382449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.382534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.382624] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.569269] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1072.569514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.569696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.569925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.570355] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.885823] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.886059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.886140] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.886355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.886519] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.886617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.886682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.886856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.886932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.887027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.887211] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.887314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.887372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.887516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.887656] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.887742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.887914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.887969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.888012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.888094] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.888183] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.072183] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.072499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.382983] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1073.383302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.391862] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3921e17-5705-42fe-988b-f0c37340437f: rpc.has_security_group_logging(os_id): False [ 1073.409017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.409017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.409017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.409017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.409596] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.409596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.409596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.409596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.409596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.409596] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3921e17-5705-42fe-988b-f0c37340437f is going to be created. [ 1073.467749] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.467928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.468059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.468545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.468632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.478392] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: IN_PROGRESS for 2s [ 1073.525851] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1073.526182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.526364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.526612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.526782] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.526900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.526975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.527205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.527294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.527382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.527476] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.029685] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.029845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.029918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.030180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.030353] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.030457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.030521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.030672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.030761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.030847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.030992] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.031098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.031157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.031293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.031430] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.031521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.031581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.031720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.031973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.031973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.031973] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.094930] env[62620]: INFO networking_nsxv3.common.synchronization [None req-f44ba57f-87f8-48be-87c2-9fca7c14c518 None None] Enqueued Resource ID: 9c4f3e39-1935-43e0-bdab-860603f9cb25 with Priority: HIGHEST for action port [ 1074.095533] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4f3e39-1935-43e0-bdab-860603f9cb25 with Priority: HIGHEST for action port [ 1074.095840] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c4f3e39-1935-43e0-bdab-860603f9cb25 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.096095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c4f3e39-1935-43e0-bdab-860603f9cb25" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.096552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c4f3e39-1935-43e0-bdab-860603f9cb25" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.096836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c4f3e39-1935-43e0-bdab-860603f9cb25" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.096923] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c4f3e39-1935-43e0-bdab-860603f9cb25',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.534137] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5: rpc.has_security_group_logging(os_id): False [ 1074.551618] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.551774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.551835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.552068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.552164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.552392] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.552492] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.552548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.552704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.552844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.552946] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.553110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.553163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.553274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.553337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.553562] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.553673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.553673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.553780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.553869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.553997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be updated. [ 1074.598991] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c4f3e39-1935-43e0-bdab-860603f9cb25 [ 1074.600201] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.600201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.600201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.600201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.600201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.600201] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c4f3e39-1935-43e0-bdab-860603f9cb25 already deleted. [ 1074.600201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c4f3e39-1935-43e0-bdab-860603f9cb25" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.613510] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.613712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.613830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.614084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.614720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.627378] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1075.426733] env[62620]: INFO networking_nsxv3.common.synchronization [req-4b0e581b-c747-4421-ba7b-653773613c84 req-a747c69d-8296-440b-8b8f-6a375388c0a9 tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1075.426836] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1075.427566] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.427566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.427566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.430702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.430840] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.430941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.431010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.431202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.431304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.431423] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.491315] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: SUCCESS [ 1075.491867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.769024] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.769024] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.769024] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.769872] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.770500] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.770629] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.770798] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.771077] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.771285] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.771566] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.771731] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.771892] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.772092] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.772229] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.772385] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.772576] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.793190] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.793190] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.793190] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.793438] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.793836] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-75c54554-1d03-46ab-bb41-d84aca2543fe taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.794662] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-75c54554-1d03-46ab-bb41-d84aca2543fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.794662] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-75c54554-1d03-46ab-bb41-d84aca2543fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.794662] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-75c54554-1d03-46ab-bb41-d84aca2543fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.794821] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75c54554-1d03-46ab-bb41-d84aca2543fe',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.934312] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.934467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.934543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.934776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.934870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.935102] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.935216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.935280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.935436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.935512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.935596] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c already deleted. [ 1075.935678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.297505] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.297772] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.297908] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.298232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.298416] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.298588] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 75c54554-1d03-46ab-bb41-d84aca2543fe not found, creating... [ 1076.298854] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.299029] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.299154] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.299388] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.299534] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.299824] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.299985] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.300281] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.300513] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.300659] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.300952] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 75c54554-1d03-46ab-bb41-d84aca2543fe is going to be created. [ 1076.322654] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.323035] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.323283] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.323726] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.324173] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.324562] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-75c54554-1d03-46ab-bb41-d84aca2543fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.641287] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1076.641594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.641672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.641892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.641981] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.711216] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b8881e08-6e9f-417a-82cc-8b8d9d3009ff None None] Enqueued Resource ID: af904c7d-6e2d-49d5-9af6-cc6e0850b6c1 with Priority: HIGHEST for action port [ 1076.711460] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af904c7d-6e2d-49d5-9af6-cc6e0850b6c1 with Priority: HIGHEST for action port [ 1076.712036] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-af904c7d-6e2d-49d5-9af6-cc6e0850b6c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.712158] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af904c7d-6e2d-49d5-9af6-cc6e0850b6c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.712226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af904c7d-6e2d-49d5-9af6-cc6e0850b6c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.712489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af904c7d-6e2d-49d5-9af6-cc6e0850b6c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.712565] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af904c7d-6e2d-49d5-9af6-cc6e0850b6c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.111681] env[62620]: INFO networking_nsxv3.common.synchronization [req-4b0e581b-c747-4421-ba7b-653773613c84 req-dec78198-1e74-439a-ae65-73b33941619a service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1077.111995] env[62620]: INFO networking_nsxv3.common.synchronization [req-4b0e581b-c747-4421-ba7b-653773613c84 req-dec78198-1e74-439a-ae65-73b33941619a service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1077.112373] env[62620]: INFO networking_nsxv3.common.synchronization [req-4b0e581b-c747-4421-ba7b-653773613c84 req-dec78198-1e74-439a-ae65-73b33941619a service nova] Enqueued Resource ID: 75c54554-1d03-46ab-bb41-d84aca2543fe with Priority: HIGHEST for action port [ 1077.116045] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1077.116045] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1077.116045] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c54554-1d03-46ab-bb41-d84aca2543fe with Priority: HIGHEST for action port [ 1077.116045] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.116045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.116045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.116045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.116045] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.116045] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.116782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.116782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.116782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.116782] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.116782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.116782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.117082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.117082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.117082] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.117879] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-75c54554-1d03-46ab-bb41-d84aca2543fe taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.117981] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75c54554-1d03-46ab-bb41-d84aca2543fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.118059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75c54554-1d03-46ab-bb41-d84aca2543fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.119706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75c54554-1d03-46ab-bb41-d84aca2543fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.119706] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75c54554-1d03-46ab-bb41-d84aca2543fe',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.145059] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.145059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.145059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.145059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.145059] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.145059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.145059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.145059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.145611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.145611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.145611] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.214350] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af904c7d-6e2d-49d5-9af6-cc6e0850b6c1 [ 1077.214579] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.214712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.214791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.215012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.215109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.215203] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af904c7d-6e2d-49d5-9af6-cc6e0850b6c1 already deleted. [ 1077.215286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af904c7d-6e2d-49d5-9af6-cc6e0850b6c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.619586] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.620790] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.620906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.621288] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75c54554-1d03-46ab-bb41-d84aca2543fe with status ACTIVE [ 1077.621453] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.621555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.621624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.621833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.621921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.622102] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.622209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.622269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.622424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.622505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.622722] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.622773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.622836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.622962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.623118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.623214] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75c54554-1d03-46ab-bb41-d84aca2543fe is going to be updated. [ 1077.646313] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.646458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.646534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.646734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.646864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.647098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75c54554-1d03-46ab-bb41-d84aca2543fe" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.647493] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.647615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.647676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.647853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.648015] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.648122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.648187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.649321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.649321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.649321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.649321] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.649321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.649321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.649321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.649321] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.649321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.649321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.649321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.649937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.649937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.649937] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.122100] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.154895] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5: rpc.has_security_group_logging(os_id): False [ 1078.178297] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.178598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.178672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.178845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.178939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.179210] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.179318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.179383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.179546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.179628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.179815] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.179910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.179972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.180126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.180202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.180380] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.180473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.180534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.180671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.180744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.180830] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be updated. [ 1078.252808] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.252957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.253040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.253276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.253425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.266375] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1078.626015] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.626015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.626015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.626015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.626015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.626015] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be created. [ 1078.647316] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.647466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.647666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.647914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.648099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.658116] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: UNINITIALIZED for 2s [ 1080.161865] env[62620]: INFO networking_nsxv3.common.synchronization [req-8fa51ddd-9cc5-4d9e-b522-0065a6986d81 req-df864d0e-7f33-4932-856a-310f34a912da tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1080.161865] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1080.161865] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.161865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.164456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.164456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.164456] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.164456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.164456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.164456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.164456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.164456] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.280338] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1080.280757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.319991] env[62620]: INFO networking_nsxv3.common.synchronization [req-ead37ed3-5e14-4101-b96c-8012ccf4ef68 req-8ab51dec-8547-4974-b0d8-be66d1c6c8a3 tempest-ImagesNegativeTestJSON-890659973 tempest-ImagesNegativeTestJSON-890659973-project-member] Enqueued Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGHEST for action security_group_members [ 1080.320838] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGHEST for action security_group_members [ 1080.321157] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-155d9c67-3c1f-4b2c-9601-a53c9b438946 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.321323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.321393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.321699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.321877] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.322013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.322084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.322246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.322331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.322424] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('155d9c67-3c1f-4b2c-9601-a53c9b438946',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.667351] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1080.667559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.667967] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.668130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.668199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.668409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.668494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.668685] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.668786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.668838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.668983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.669070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.669157] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1080.670064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.670236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.670384] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.670491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.670552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.670691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.670765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.670846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.670935] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.696812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.697023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.697023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.697257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.697404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.706347] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1080.825648] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.825912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.825912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.826203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.826319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.826548] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.826670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.826735] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.826916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.827016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.827113] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 already deleted. [ 1080.827198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.909676] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.910076] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-809" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.910076] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-809" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.910469] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-809" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.910785] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.911038] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.911153] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.911426] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.911615] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.911855] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.912025] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.912175] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.912319] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.912501] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.912604] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.912777] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.930702] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.930926] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.931112] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.931477] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-809" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.931923] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-a3ecaa14-2705-45f1-a66a-eb481153f099 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.932252] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-a3ecaa14-2705-45f1-a66a-eb481153f099" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.932475] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-a3ecaa14-2705-45f1-a66a-eb481153f099" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.932878] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-a3ecaa14-2705-45f1-a66a-eb481153f099" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.933184] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3ecaa14-2705-45f1-a66a-eb481153f099',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.173377] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.173612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.173612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.173824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.174035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.174117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.174203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.174368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.174457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.174544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.174695] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.174786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.174845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.174980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.175129] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.175223] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.175279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.175412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.175517] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.175551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.175636] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.436600] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.436600] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.436600] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.436854] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.436984] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.437165] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port a3ecaa14-2705-45f1-a66a-eb481153f099 not found, creating... [ 1081.437453] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.437621] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.437742] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.437966] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.438124] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.438414] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.438606] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.438693] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.438900] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.439048] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.439201] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: a3ecaa14-2705-45f1-a66a-eb481153f099 is going to be created. [ 1081.457369] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.457592] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.457707] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.457963] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.458211] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.458460] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-a3ecaa14-2705-45f1-a66a-eb481153f099" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.681078] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5026804-13b5-4b49-b1b4-b00084a12c8c: rpc.has_security_group_logging(os_id): False [ 1081.699233] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.699398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.699533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.699687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.699774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.699962] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.700088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.700127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.700272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.700920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.701156] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.701254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.701323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.701553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.701553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.701722] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.702039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.702039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.702039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.702156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.702156] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be created. [ 1081.754073] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.754242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.754284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.754490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.754667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.764783] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1082.168560] env[62620]: INFO networking_nsxv3.common.synchronization [req-ead37ed3-5e14-4101-b96c-8012ccf4ef68 req-700853e8-60c9-4a87-9838-298f4a99a3de service nova] Enqueued Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGHEST for action security_group_rules [ 1082.168803] env[62620]: INFO networking_nsxv3.common.synchronization [req-ead37ed3-5e14-4101-b96c-8012ccf4ef68 req-700853e8-60c9-4a87-9838-298f4a99a3de service nova] Enqueued Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGHEST for action security_group_members [ 1082.168986] env[62620]: INFO networking_nsxv3.common.synchronization [req-ead37ed3-5e14-4101-b96c-8012ccf4ef68 req-700853e8-60c9-4a87-9838-298f4a99a3de service nova] Enqueued Resource ID: a3ecaa14-2705-45f1-a66a-eb481153f099 with Priority: HIGHEST for action port [ 1082.170930] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGHEST for action security_group_rules [ 1082.170930] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGHEST for action security_group_members [ 1082.171738] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ecaa14-2705-45f1-a66a-eb481153f099 with Priority: HIGHEST for action port [ 1082.171738] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-155d9c67-3c1f-4b2c-9601-a53c9b438946 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.171947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.171947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.172184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.172565] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('155d9c67-3c1f-4b2c-9601-a53c9b438946',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.173191] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-155d9c67-3c1f-4b2c-9601-a53c9b438946 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.173490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.173490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.173763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.173763] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.173851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.174025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.174109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.174216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.174312] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('155d9c67-3c1f-4b2c-9601-a53c9b438946',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.175193] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3ecaa14-2705-45f1-a66a-eb481153f099 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.175314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3ecaa14-2705-45f1-a66a-eb481153f099" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.175923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3ecaa14-2705-45f1-a66a-eb481153f099" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.175923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3ecaa14-2705-45f1-a66a-eb481153f099" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.175923] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3ecaa14-2705-45f1-a66a-eb481153f099',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.677474] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('155d9c67-3c1f-4b2c-9601-a53c9b438946',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.678590] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-155d9c67-3c1f-4b2c-9601-a53c9b438946 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.678590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.678753] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3ecaa14-2705-45f1-a66a-eb481153f099 with status ACTIVE [ 1082.678868] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.678974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.679091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.679256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.679343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.679514] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.679614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.679677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.679838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.679931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.680104] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.680199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.680259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.680398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.680468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.680575] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3ecaa14-2705-45f1-a66a-eb481153f099 is going to be updated. [ 1082.700181] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.700325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.700405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.700631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.700772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.700924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3ecaa14-2705-45f1-a66a-eb481153f099" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.716246] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1082.716415] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 1082.716518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.183148] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('155d9c67-3c1f-4b2c-9601-a53c9b438946',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.684837] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.684968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.684968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.685186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.685275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.685409] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 is going to be created. [ 1083.707584] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.707729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.707800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.708014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.708178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.717110] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 in Status: UNINITIALIZED for 2s [ 1083.777584] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1083.777822] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.780975] env[62620]: INFO networking_nsxv3.common.synchronization [req-c2dcb77e-a8e6-41b8-83e5-1e10eb1d71f6 req-73e65861-c204-46b0-9d3f-2b3328b41530 tempest-ListServerFiltersTestJSON-1687006819 tempest-ListServerFiltersTestJSON-1687006819-project-member] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1084.781549] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1084.782279] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.782410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.782479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.782680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.782835] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.782930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.782992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.786101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.786101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.786101] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.285610] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.729253] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 in Status: SUCCESS [ 1085.729501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1085.729671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.729921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.730133] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.730258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.730325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.730485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.730627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1085.730736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1085.730830] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('155d9c67-3c1f-4b2c-9601-a53c9b438946',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.787758] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.234044] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-155d9c67-3c1f-4b2c-9601-a53c9b438946 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.234206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.234282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.234502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.234666] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.234764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.234828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.234978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.235079] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.235169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.235319] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-155d9c67-3c1f-4b2c-9601-a53c9b438946 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.235411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.235471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.235610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.235742] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.235831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.235948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.236626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.236626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.236626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.236626] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('155d9c67-3c1f-4b2c-9601-a53c9b438946',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.289891] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.290058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.290137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.290350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.290441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.290546] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be updated. [ 1086.318534] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.318680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.318752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.318962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.319119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.328801] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1086.741189] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 155d9c67-3c1f-4b2c-9601-a53c9b438946: rpc.has_security_group_logging(os_id): False [ 1086.758525] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.758525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.758672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.758837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.758927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.759150] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.759261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.759325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.759470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.759558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.759755] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.759860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.759923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.760088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.760188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.760370] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.760464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.760536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.760698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.760789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.760875] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 is going to be created. [ 1086.815355] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.815753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.815753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.816729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.816729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.827618] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 in Status: IN_PROGRESS for 2s [ 1088.337508] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1088.337993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1088.843850] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 in Status: SUCCESS [ 1088.844171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.782743] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1089.783035] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1091.117790] env[62620]: INFO networking_nsxv3.common.synchronization [req-68ee26e6-8bc4-42b7-99d1-d20d84e12aca req-78e5e073-30d1-45fe-874c-23d2e029cb0f tempest-ListServerFiltersTestJSON-1687006819 tempest-ListServerFiltersTestJSON-1687006819-project-member] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1091.118272] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1091.118578] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.118696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.118766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.119440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.119615] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.119891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.119891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.119986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.120037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.120137] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.213295] env[62620]: INFO networking_nsxv3.common.synchronization [req-76d6e289-0c76-42c2-a170-665d540d0b0b req-93287831-bb5a-4ac8-8ec3-e24d2ac8ae92 tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1091.214124] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1091.214436] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.214559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.214628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.214818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.214965] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.215476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.215554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.215717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.215804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.216013] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.500136] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.500366] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.500519] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.500796] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.501189] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.501397] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.501524] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.502189] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.502189] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.502189] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.502325] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.502419] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.502535] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.502651] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.502761] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.502906] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.521960] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.522104] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.522215] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.522395] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.522703] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-83a5bd04-2ff4-4441-aa87-768435659d4d taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.522881] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-83a5bd04-2ff4-4441-aa87-768435659d4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.523074] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-83a5bd04-2ff4-4441-aa87-768435659d4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.523349] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-83a5bd04-2ff4-4441-aa87-768435659d4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.523491] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83a5bd04-2ff4-4441-aa87-768435659d4d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.622613] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.718254] env[62620]: INFO networking_nsxv3.common.synchronization [req-0728787c-a739-4271-97c1-9268e19b25bd req-1ab2ecaf-c16e-440d-a2b3-5781577c6d4d tempest-ImagesNegativeTestJSON-890659973 tempest-ImagesNegativeTestJSON-890659973-project-member] Enqueued Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGHEST for action security_group_members [ 1091.718254] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.718254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.718254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.719203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.719651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.719890] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.722658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.722658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.722658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.722658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.722658] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1091.722658] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGHEST for action security_group_members [ 1091.722658] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-155d9c67-3c1f-4b2c-9601-a53c9b438946 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.722658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.722658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.723407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.723708] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.723963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.724174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.724442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.725687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.725893] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('155d9c67-3c1f-4b2c-9601-a53c9b438946',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.759597] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.759749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.759820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.760042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.760192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.768964] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1092.025922] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.026341] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.026499] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.026784] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.026943] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.027126] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 83a5bd04-2ff4-4441-aa87-768435659d4d not found, creating... [ 1092.027500] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.027684] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.027808] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.028043] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.028191] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.028473] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.028634] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.028754] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.028965] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.029164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.029315] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 83a5bd04-2ff4-4441-aa87-768435659d4d is going to be created. [ 1092.051630] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.051822] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.051954] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.052255] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.052490] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.052717] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-83a5bd04-2ff4-4441-aa87-768435659d4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.125446] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.231350] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.231350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.231350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.231350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.231350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.231350] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.231350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.231350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.231350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.231350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.231350] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 is going to be updated. [ 1092.259314] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.259314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.259314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.259314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.259314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.268487] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 in Status: IN_PROGRESS for 2s [ 1092.630523] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.630523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.630523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.630523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.630523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.630523] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be updated. [ 1092.658906] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.659150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.659150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.659588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.659588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.673631] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1092.828940] env[62620]: INFO networking_nsxv3.common.synchronization [req-76d6e289-0c76-42c2-a170-665d540d0b0b req-d97efc47-a3f6-418b-973c-f826a884822b service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 1092.829161] env[62620]: INFO networking_nsxv3.common.synchronization [req-76d6e289-0c76-42c2-a170-665d540d0b0b req-d97efc47-a3f6-418b-973c-f826a884822b service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1092.829292] env[62620]: INFO networking_nsxv3.common.synchronization [req-76d6e289-0c76-42c2-a170-665d540d0b0b req-d97efc47-a3f6-418b-973c-f826a884822b service nova] Enqueued Resource ID: 83a5bd04-2ff4-4441-aa87-768435659d4d with Priority: HIGHEST for action port [ 1092.829563] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 1092.829651] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1092.829749] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a5bd04-2ff4-4441-aa87-768435659d4d with Priority: HIGHEST for action port [ 1092.830437] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.830516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.830559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.830773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.830813] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.831635] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.831768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.832008] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-83a5bd04-2ff4-4441-aa87-768435659d4d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.832125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83a5bd04-2ff4-4441-aa87-768435659d4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.832194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83a5bd04-2ff4-4441-aa87-768435659d4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.832351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83a5bd04-2ff4-4441-aa87-768435659d4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.832457] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83a5bd04-2ff4-4441-aa87-768435659d4d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.335000] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.335000] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.335000] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83a5bd04-2ff4-4441-aa87-768435659d4d with status ACTIVE [ 1093.335418] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.335418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.335418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.335550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.335655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.335809] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.335907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.335968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.336136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.336214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.336419] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.336515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.336577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.336778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.336877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.336921] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83a5bd04-2ff4-4441-aa87-768435659d4d is going to be updated. [ 1093.356849] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.356987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.357067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.357316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.357495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.358371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83a5bd04-2ff4-4441-aa87-768435659d4d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.780327] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1093.780327] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 1093.780327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.780519] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.781544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.781544] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.781544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.781544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.781544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.781544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.781544] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.278298] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 in Status: SUCCESS [ 1094.278521] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 deletion is rescheduled due to dependency. [ 1094.278672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1094.283034] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.682275] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1094.682662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1094.785135] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.287613] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.287804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.287875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.288088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.288186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.288274] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1095.316473] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.316611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.316693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.316910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.317066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.325259] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1095.844826] env[62620]: INFO networking_nsxv3.common.synchronization [req-552c8601-5415-4ee1-a9a5-e69b13eacbb5 req-c6f33971-9bdb-4ad5-b4ef-a468d338feca tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1095.845363] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1095.845675] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.845815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.845848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.846065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.846546] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.846546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.846546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.846704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.846704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.846800] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.349198] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.349385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.349511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.349766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.349884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.350147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.350285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.350357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.350723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.350723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.350723] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3921e17-5705-42fe-988b-f0c37340437f is going to be updated. [ 1096.376544] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.376692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.376763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.376961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.377136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.384819] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: IN_PROGRESS for 2s [ 1097.338414] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1097.338414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.338414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.338414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.338853] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.338853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.338853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.338976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.338976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.339384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.339384] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.574808] env[62620]: INFO networking_nsxv3.common.synchronization [req-0f753cbb-8047-4ac0-a4e1-0001f8b7b4ea req-ffcce59b-40b9-4f94-8fe4-371f21a5d3fa tempest-ServersTestFqdnHostnames-27247144 tempest-ServersTestFqdnHostnames-27247144-project-member] Enqueued Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_members [ 1097.576377] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGHEST for action security_group_members [ 1097.576714] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-84fabf93-4432-40c4-890b-0bf1580dbb93 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.576839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.576895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.577103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.577254] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.577350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.577598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.577598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.577719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.577768] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.844747] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.844747] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.844747] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.844747] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.844747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.845409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.845409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.845409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.845409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.845409] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.953378] env[62620]: INFO networking_nsxv3.common.synchronization [req-dcf62b44-4998-476e-a5df-d8d19a25c78f req-2d62447e-4fac-4217-b54c-68331f4ef0b8 tempest-ListServerFiltersTestJSON-1687006819 tempest-ListServerFiltersTestJSON-1687006819-project-member] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1097.953378] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGHEST for action security_group_members [ 1097.953378] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.953378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.953378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.953378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.953378] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.953378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.953378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.953378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.954416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.957396] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.080853] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.080853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.081047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.081162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.081254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.081460] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.081621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.081621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.084017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.084017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.084017] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 is going to be updated. [ 1098.109636] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.109829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.109829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.110077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.110222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.118407] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 in Status: IN_PROGRESS for 2s [ 1098.347632] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c469d6d-346a-40a2-adb5-8c50f7758224: rpc.has_security_group_logging(os_id): False [ 1098.369229] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.369403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.369462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.369795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.369951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.370171] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.370275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.370340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.370499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.370578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.370781] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.370887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.370949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.371082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.371156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.371331] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.371426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.371489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.371624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.371697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.371780] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1098.396842] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: SUCCESS [ 1098.397042] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3921e17-5705-42fe-988b-f0c37340437f deletion is rescheduled due to dependency. [ 1098.397161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.428191] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.428395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.428443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.428666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.428814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.453478] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1098.457054] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.457239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.457329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.457556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.457655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.457873] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.457977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.458049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.458212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.458289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.458379] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be updated. [ 1098.492072] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.492237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.492308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.492514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.492655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.507246] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: IN_PROGRESS for 2s [ 1098.757797] env[62620]: INFO networking_nsxv3.common.synchronization [req-ebcb8a7d-435d-4640-a6ff-9951422d3f58 req-36cf0fb2-9531-4489-9b7e-596106cb3cd0 tempest-ServersTestManualDisk-1682543278 tempest-ServersTestManualDisk-1682543278-project-member] Enqueued Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_members [ 1098.758360] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGHEST for action security_group_members [ 1098.758701] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9338b344-e20e-4f2c-889d-3246eaae326d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.758787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.758856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.759107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.759222] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.759776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.759776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.759776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.759776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.759776] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.069060] env[62620]: INFO networking_nsxv3.common.synchronization [req-4dd10e3c-0fa9-4220-97c6-eab1eeee5905 req-e98dd9cf-e74e-4015-ab02-42390bae85d6 tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1099.069060] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1099.069060] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.069060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.069060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.069060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.069060] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.069060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.069060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.069060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.069060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.069060] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.261956] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.262241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.262241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.262432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.262525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.262758] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.262864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.262926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.263097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.263176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.263258] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9338b344-e20e-4f2c-889d-3246eaae326d is going to be updated. [ 1099.292060] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.292349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.292349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.292446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.292575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.312774] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9338b344-e20e-4f2c-889d-3246eaae326d in Status: IN_PROGRESS for 2s [ 1099.570273] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.570586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.570586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.570785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.570785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.570968] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.571088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.571152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.571308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.571385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.571474] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1099.598423] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.598720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.598720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.599053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.599053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.607476] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1100.127954] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 in Status: SUCCESS [ 1100.128709] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 deletion is rescheduled due to dependency. [ 1100.129024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.467400] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1100.468464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.515610] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 in Status: SUCCESS [ 1100.515807] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 deletion is rescheduled due to dependency. [ 1100.515951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.322571] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9338b344-e20e-4f2c-889d-3246eaae326d in Status: SUCCESS [ 1101.322868] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9338b344-e20e-4f2c-889d-3246eaae326d deletion is rescheduled due to dependency. [ 1101.322868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.616897] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1101.617146] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c deletion is rescheduled due to dependency. [ 1101.617676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.925956] env[62620]: INFO networking_nsxv3.common.synchronization [None req-e74922f5-07d7-4f89-80cb-fc3566817636 None None] Enqueued Resource ID: 27f8a1ad-3eb8-4e74-916a-ad31e2091fe8 with Priority: HIGHEST for action port [ 1101.926554] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27f8a1ad-3eb8-4e74-916a-ad31e2091fe8 with Priority: HIGHEST for action port [ 1101.926927] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-27f8a1ad-3eb8-4e74-916a-ad31e2091fe8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.927097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27f8a1ad-3eb8-4e74-916a-ad31e2091fe8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.927290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27f8a1ad-3eb8-4e74-916a-ad31e2091fe8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.927399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27f8a1ad-3eb8-4e74-916a-ad31e2091fe8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.927486] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f8a1ad-3eb8-4e74-916a-ad31e2091fe8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.434449] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27f8a1ad-3eb8-4e74-916a-ad31e2091fe8 [ 1102.434449] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.434449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.434449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.434449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.434449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.434449] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27f8a1ad-3eb8-4e74-916a-ad31e2091fe8 already deleted. [ 1102.434449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27f8a1ad-3eb8-4e74-916a-ad31e2091fe8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.612137] env[62620]: INFO networking_nsxv3.common.synchronization [None req-570bb62f-9ba7-49ed-b150-d1e3046c2f6e tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_rules [ 1102.612933] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_rules [ 1102.613554] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.615513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.615513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.615513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.615513] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.693799] env[62620]: INFO networking_nsxv3.common.synchronization [None req-fa432874-c9de-4216-8f30-999f94737c48 tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_rules [ 1102.694544] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_rules [ 1102.694910] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.695051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.241218] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.241218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.241218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.241218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.241218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.241218] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a already deleted. [ 1103.241218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.241218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.241218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.241218] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.669019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.669019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.669019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.669019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.669019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.669019] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a already deleted. [ 1103.669019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.983575] env[62620]: INFO networking_nsxv3.common.synchronization [None req-f1105506-2f0d-4ad3-99c4-a94332002dbd None None] Enqueued Resource ID: 8a3135b9-c961-4f5f-b521-c2af1cb824f5 with Priority: HIGHEST for action port [ 1103.984261] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3135b9-c961-4f5f-b521-c2af1cb824f5 with Priority: HIGHEST for action port [ 1103.984625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a3135b9-c961-4f5f-b521-c2af1cb824f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.984803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a3135b9-c961-4f5f-b521-c2af1cb824f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.984864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a3135b9-c961-4f5f-b521-c2af1cb824f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.987231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a3135b9-c961-4f5f-b521-c2af1cb824f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.987695] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a3135b9-c961-4f5f-b521-c2af1cb824f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.385197] env[62620]: INFO networking_nsxv3.common.synchronization [req-f96753b7-9af5-4794-b152-37feb479e8d0 req-4a02972f-3f28-4ad8-8bd5-b606095fcbd4 tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1104.385719] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1104.386041] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.386169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.386234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.386460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.386620] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.386720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.386781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.386926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.387311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.387311] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.490191] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a3135b9-c961-4f5f-b521-c2af1cb824f5 [ 1104.490432] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.490560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.490628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.490843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.490935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.491050] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a3135b9-c961-4f5f-b521-c2af1cb824f5 already deleted. [ 1104.491120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a3135b9-c961-4f5f-b521-c2af1cb824f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.742604] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.742949] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.742949] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.743270] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.743574] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.743756] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.743883] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.744141] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.744725] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.744725] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.744725] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.744903] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.744953] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.745068] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.745186] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.745328] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.765262] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.765474] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.765674] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.765946] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.766354] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-880f6f52-e5e1-4cef-ac19-65931c8f46a6 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.766582] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-880f6f52-e5e1-4cef-ac19-65931c8f46a6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.766985] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-880f6f52-e5e1-4cef-ac19-65931c8f46a6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.767104] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-880f6f52-e5e1-4cef-ac19-65931c8f46a6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.767248] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('880f6f52-e5e1-4cef-ac19-65931c8f46a6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.889263] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.889419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.889502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.889731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.889824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.890034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.890137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.890201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.891131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.891131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.891131] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1104.915946] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.916100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.916161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.916358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.916621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.925372] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1105.269140] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.269399] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.269598] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.269919] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.270094] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.270259] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 880f6f52-e5e1-4cef-ac19-65931c8f46a6 not found, creating... [ 1105.270530] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.270708] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.270896] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.271114] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.271267] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.271588] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.271824] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.271950] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.272181] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.272325] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.272470] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 880f6f52-e5e1-4cef-ac19-65931c8f46a6 is going to be created. [ 1105.291401] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.291592] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.291720] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.291964] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.292212] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.292436] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-880f6f52-e5e1-4cef-ac19-65931c8f46a6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.065791] env[62620]: INFO networking_nsxv3.common.synchronization [req-f96753b7-9af5-4794-b152-37feb479e8d0 req-d1bc1eb4-a6fe-4003-b557-62f442ff2446 service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1106.065791] env[62620]: INFO networking_nsxv3.common.synchronization [req-f96753b7-9af5-4794-b152-37feb479e8d0 req-d1bc1eb4-a6fe-4003-b557-62f442ff2446 service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1106.065791] env[62620]: INFO networking_nsxv3.common.synchronization [req-f96753b7-9af5-4794-b152-37feb479e8d0 req-d1bc1eb4-a6fe-4003-b557-62f442ff2446 service nova] Enqueued Resource ID: 880f6f52-e5e1-4cef-ac19-65931c8f46a6 with Priority: HIGHEST for action port [ 1106.067996] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1106.067996] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1106.067996] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 880f6f52-e5e1-4cef-ac19-65931c8f46a6 with Priority: HIGHEST for action port [ 1106.067996] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.067996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.067996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.067996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.067996] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.068703] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.068799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.068960] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-880f6f52-e5e1-4cef-ac19-65931c8f46a6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.069066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-880f6f52-e5e1-4cef-ac19-65931c8f46a6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.069132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-880f6f52-e5e1-4cef-ac19-65931c8f46a6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.069297] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-880f6f52-e5e1-4cef-ac19-65931c8f46a6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.069366] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('880f6f52-e5e1-4cef-ac19-65931c8f46a6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.573299] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 880f6f52-e5e1-4cef-ac19-65931c8f46a6 with status ACTIVE [ 1106.573299] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.573299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.573299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.573299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.573299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.573299] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.573299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.573299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.573299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.573299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.573299] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.573299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.574232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.574232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.574232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.574232] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 880f6f52-e5e1-4cef-ac19-65931c8f46a6 is going to be updated. [ 1106.574756] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.574844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.594750] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.595145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.595267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.595490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.595629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.595972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-880f6f52-e5e1-4cef-ac19-65931c8f46a6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.618898] env[62620]: INFO networking_nsxv3.common.synchronization [req-c389e02a-f21d-4da9-ad55-b2a342771dcd req-215b5b2e-89f1-4dc2-aed2-0dee775706a0 tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1106.619370] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1106.619674] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.619900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.619900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.620193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.620361] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.620467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.620535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.620687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.620769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.620856] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.935346] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1106.935543] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c deletion is rescheduled due to dependency. [ 1106.935685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.935848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.936131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.936366] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.936522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.936594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.936757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.936854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.936975] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.124017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.124017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.124017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.124017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.124017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.124017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.124529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.124529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.124529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.124529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.124529] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1107.154077] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.154236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.154311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.154570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.154720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.170883] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1107.439358] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.941703] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.445541] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.446029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.446029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.446087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.446152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.446258] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1108.473308] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.473537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.473650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.473967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.474202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.482748] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1109.183299] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1109.183299] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 1109.183299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.494964] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1110.495314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.495452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.495702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.495964] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.496080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.496173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.496394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.496522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.496638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.496754] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.000025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.000178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.000178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.000178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.000178] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.000763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.000763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.000852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.000950] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.001023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.001173] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.001275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.001341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.001459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.001700] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.001700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.001829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.001866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.001938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.002026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.002157] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.418064] env[62620]: INFO networking_nsxv3.common.synchronization [None req-8e265989-26fd-49f7-a375-3a3331ccc614 None None] Enqueued Resource ID: c4489ad2-1c98-4771-bd90-5fbdb48e8715 with Priority: HIGHEST for action port [ 1111.418064] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4489ad2-1c98-4771-bd90-5fbdb48e8715 with Priority: HIGHEST for action port [ 1111.418064] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4489ad2-1c98-4771-bd90-5fbdb48e8715 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.418064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4489ad2-1c98-4771-bd90-5fbdb48e8715" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.418064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4489ad2-1c98-4771-bd90-5fbdb48e8715" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.418064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4489ad2-1c98-4771-bd90-5fbdb48e8715" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.418064] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4489ad2-1c98-4771-bd90-5fbdb48e8715',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.460019] env[62620]: INFO networking_nsxv3.common.synchronization [None req-dabfc9c6-94e9-43be-8cbc-27d0baa0a577 None None] Enqueued Resource ID: 3504efc3-eea4-4fde-807e-aadabd636a7e with Priority: HIGHEST for action port [ 1111.460019] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3504efc3-eea4-4fde-807e-aadabd636a7e with Priority: HIGHEST for action port [ 1111.460019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-3504efc3-eea4-4fde-807e-aadabd636a7e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.460019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3504efc3-eea4-4fde-807e-aadabd636a7e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.460019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3504efc3-eea4-4fde-807e-aadabd636a7e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.460019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3504efc3-eea4-4fde-807e-aadabd636a7e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.460019] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3504efc3-eea4-4fde-807e-aadabd636a7e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.504567] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5026804-13b5-4b49-b1b4-b00084a12c8c: rpc.has_security_group_logging(os_id): False [ 1111.521823] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.521976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.522045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.522270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.522356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.522556] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.522647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.522707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.522852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.523118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.523118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.523229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.523273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.524201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.524201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.524201] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.524201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.524201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.524201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.524201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.524201] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1111.595083] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.595293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.595361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.595523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.595669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.607855] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1111.923900] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4489ad2-1c98-4771-bd90-5fbdb48e8715 [ 1111.924252] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.924354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.924414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.924665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.924755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.924853] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4489ad2-1c98-4771-bd90-5fbdb48e8715 already deleted. [ 1111.924935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4489ad2-1c98-4771-bd90-5fbdb48e8715" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.963328] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3504efc3-eea4-4fde-807e-aadabd636a7e [ 1111.963628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.963840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.963921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.964118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.964263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.964337] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3504efc3-eea4-4fde-807e-aadabd636a7e already deleted. [ 1111.964510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3504efc3-eea4-4fde-807e-aadabd636a7e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.623295] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1113.623579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.803709] env[62620]: INFO networking_nsxv3.common.synchronization [None req-e08fe7a8-1819-45f4-904b-e90e5dd5f3c7 None None] Enqueued Resource ID: 064227a9-000f-4010-ba95-212a206d70c1 with Priority: HIGHEST for action port [ 1113.804446] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 064227a9-000f-4010-ba95-212a206d70c1 with Priority: HIGHEST for action port [ 1113.804912] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-064227a9-000f-4010-ba95-212a206d70c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.805164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-064227a9-000f-4010-ba95-212a206d70c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.805286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-064227a9-000f-4010-ba95-212a206d70c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.805605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-064227a9-000f-4010-ba95-212a206d70c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.805695] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('064227a9-000f-4010-ba95-212a206d70c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.311549] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 064227a9-000f-4010-ba95-212a206d70c1 [ 1114.311549] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.311549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.311549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.311549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.311549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.311549] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:064227a9-000f-4010-ba95-212a206d70c1 already deleted. [ 1114.311549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-064227a9-000f-4010-ba95-212a206d70c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.461471] env[62620]: INFO networking_nsxv3.common.synchronization [req-14fe6df3-5429-4639-9611-43586414b5e2 req-9e08d7d5-f0e7-4e0a-ae64-2a122158bb15 tempest-InstanceActionsV221TestJSON-1439412738 tempest-InstanceActionsV221TestJSON-1439412738-project-member] Enqueued Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGHEST for action security_group_members [ 1114.462011] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGHEST for action security_group_members [ 1114.462325] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79c3337-b12e-40d4-993c-c4d5954de7b0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.462472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.462554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.463153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.463153] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.463324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.463324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.463483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.463483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.463626] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79c3337-b12e-40d4-993c-c4d5954de7b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.735348] env[62620]: INFO networking_nsxv3.common.synchronization [None req-82bc9ffa-e22c-4321-a7ab-e094cf556112 None None] Enqueued Resource ID: 2cb66318-112a-4d65-b836-ac2054eada11 with Priority: HIGHEST for action port [ 1114.736162] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cb66318-112a-4d65-b836-ac2054eada11 with Priority: HIGHEST for action port [ 1114.736560] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cb66318-112a-4d65-b836-ac2054eada11 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.736844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cb66318-112a-4d65-b836-ac2054eada11" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.736844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cb66318-112a-4d65-b836-ac2054eada11" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.737183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cb66318-112a-4d65-b836-ac2054eada11" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.737323] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cb66318-112a-4d65-b836-ac2054eada11',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.919024] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.919299] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.919377] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.919719] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.919984] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.920157] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.920281] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.920498] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.920647] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.920859] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.920980] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.925555] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.925751] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.926290] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.926465] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.926780] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.945126] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.945306] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.945451] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.945641] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.945948] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-e953f345-dc88-46fa-bee5-036a4f2d9b4c taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.946136] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-e953f345-dc88-46fa-bee5-036a4f2d9b4c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.946264] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-e953f345-dc88-46fa-bee5-036a4f2d9b4c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.946630] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-e953f345-dc88-46fa-bee5-036a4f2d9b4c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.946785] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e953f345-dc88-46fa-bee5-036a4f2d9b4c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.965591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.965779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.965861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.966074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.966165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.966432] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.966620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.966710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.966919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.967050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.967133] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 already deleted. [ 1114.967200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.004098] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b2d687ab-2f5e-4350-a6d4-786ab4e9648b tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_rules [ 1115.004098] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_rules [ 1115.004098] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.004098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.004098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.005100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.005100] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.007844] env[62620]: INFO networking_nsxv3.common.synchronization [None req-ba17a030-9a63-4d74-a6c4-5fefb95b6482 None None] Enqueued Resource ID: 680bab91-1def-4489-b02c-91633dccb086 with Priority: HIGHEST for action port [ 1115.008351] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 680bab91-1def-4489-b02c-91633dccb086 with Priority: HIGHEST for action port [ 1115.008923] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-680bab91-1def-4489-b02c-91633dccb086 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.009296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-680bab91-1def-4489-b02c-91633dccb086" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.009393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-680bab91-1def-4489-b02c-91633dccb086" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.009606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-680bab91-1def-4489-b02c-91633dccb086" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.009683] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('680bab91-1def-4489-b02c-91633dccb086',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.123586] env[62620]: INFO networking_nsxv3.common.synchronization [None req-12d63693-4512-4931-bc5a-5e9571098251 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_rules [ 1115.124120] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_rules [ 1115.124418] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.124522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.241139] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cb66318-112a-4d65-b836-ac2054eada11 [ 1115.241361] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.241491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.241564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.241784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.241872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.241964] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cb66318-112a-4d65-b836-ac2054eada11 already deleted. [ 1115.242054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cb66318-112a-4d65-b836-ac2054eada11" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.449668] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.449805] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.449920] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.450262] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.450426] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.450594] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port e953f345-dc88-46fa-bee5-036a4f2d9b4c not found, creating... [ 1115.451489] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.451489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.451489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.451489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.451782] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.451873] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.451964] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.452189] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.452510] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.452579] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.452703] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: e953f345-dc88-46fa-bee5-036a4f2d9b4c is going to be created. [ 1115.477034] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.477302] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.477386] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.477683] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.478153] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.478219] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-e953f345-dc88-46fa-bee5-036a4f2d9b4c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.514847] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 680bab91-1def-4489-b02c-91633dccb086 [ 1115.514847] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.514847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.514847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.514847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.514847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.515324] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:680bab91-1def-4489-b02c-91633dccb086 already deleted. [ 1115.517029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-680bab91-1def-4489-b02c-91633dccb086" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.539995] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.540237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.540237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.540422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.540512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.540609] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 already deleted. [ 1115.540727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.542015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.542015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.542015] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.061949] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.062281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.062281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.062490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.062490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.062596] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 already deleted. [ 1116.062673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.267844] env[62620]: INFO networking_nsxv3.common.synchronization [req-14fe6df3-5429-4639-9611-43586414b5e2 req-2d0bc309-d668-47d0-a116-3f5202565f44 service nova] Enqueued Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGHEST for action security_group_rules [ 1116.268160] env[62620]: INFO networking_nsxv3.common.synchronization [req-14fe6df3-5429-4639-9611-43586414b5e2 req-2d0bc309-d668-47d0-a116-3f5202565f44 service nova] Enqueued Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGHEST for action security_group_members [ 1116.268253] env[62620]: INFO networking_nsxv3.common.synchronization [req-14fe6df3-5429-4639-9611-43586414b5e2 req-2d0bc309-d668-47d0-a116-3f5202565f44 service nova] Enqueued Resource ID: e953f345-dc88-46fa-bee5-036a4f2d9b4c with Priority: HIGHEST for action port [ 1116.269824] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGHEST for action security_group_rules [ 1116.270013] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGHEST for action security_group_members [ 1116.270123] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e953f345-dc88-46fa-bee5-036a4f2d9b4c with Priority: HIGHEST for action port [ 1116.270455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d79c3337-b12e-40d4-993c-c4d5954de7b0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.270740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.270740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.270995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.271091] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d79c3337-b12e-40d4-993c-c4d5954de7b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.274180] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79c3337-b12e-40d4-993c-c4d5954de7b0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.274302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.274387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.274606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.274788] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.274900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.274958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.275784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.275847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.275913] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79c3337-b12e-40d4-993c-c4d5954de7b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.276932] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-e953f345-dc88-46fa-bee5-036a4f2d9b4c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.277042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e953f345-dc88-46fa-bee5-036a4f2d9b4c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.277145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e953f345-dc88-46fa-bee5-036a4f2d9b4c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.277779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e953f345-dc88-46fa-bee5-036a4f2d9b4c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.277902] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e953f345-dc88-46fa-bee5-036a4f2d9b4c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.777628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79c3337-b12e-40d4-993c-c4d5954de7b0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.777814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.781081] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d79c3337-b12e-40d4-993c-c4d5954de7b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.781081] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e953f345-dc88-46fa-bee5-036a4f2d9b4c with status ACTIVE [ 1116.781081] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.781081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.781081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.781081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.781081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.781081] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.781081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.781081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.781505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.781505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.781505] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.781505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.781632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.782338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.782338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.782338] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e953f345-dc88-46fa-bee5-036a4f2d9b4c is going to be updated. [ 1116.807160] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.807361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.807361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.808037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.808037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.808037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e953f345-dc88-46fa-bee5-036a4f2d9b4c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.288579] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d79c3337-b12e-40d4-993c-c4d5954de7b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.428370] env[62620]: INFO networking_nsxv3.common.synchronization [None req-15af9e74-7d68-4a3f-8a16-45f5fd69d88e None None] Enqueued Resource ID: 4a0ebe90-8730-461e-a938-44165445b6de with Priority: HIGHEST for action port [ 1117.429029] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a0ebe90-8730-461e-a938-44165445b6de with Priority: HIGHEST for action port [ 1117.429258] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a0ebe90-8730-461e-a938-44165445b6de taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.429386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a0ebe90-8730-461e-a938-44165445b6de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.429453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a0ebe90-8730-461e-a938-44165445b6de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.429716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a0ebe90-8730-461e-a938-44165445b6de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.429788] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a0ebe90-8730-461e-a938-44165445b6de',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.493251] env[62620]: INFO networking_nsxv3.common.synchronization [req-f6d62c26-136a-486f-aa78-0863907f5053 req-20f0c85e-d163-4f93-80b0-8ef40690fa67 tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_members [ 1117.493762] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_members [ 1117.494077] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.494198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.494318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.494561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.494684] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.494790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.494854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.495010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.495099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.495193] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.792695] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.792695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.792695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.792913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.792913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.792981] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 is going to be created. [ 1117.803260] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.803570] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.803802] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.804644] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.805049] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.805316] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.805526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.805880] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.806032] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.806332] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.806742] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.806954] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.807143] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.807326] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.807491] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.807724] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.821656] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.821828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.821897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.822108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.822270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.827479] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.827762] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1117.828009] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.828238] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.828632] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-291e9d98-ac72-43f7-b745-9f0d290580fa taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.828889] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-291e9d98-ac72-43f7-b745-9f0d290580fa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.829022] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-291e9d98-ac72-43f7-b745-9f0d290580fa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.829384] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-291e9d98-ac72-43f7-b745-9f0d290580fa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.829558] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('291e9d98-ac72-43f7-b745-9f0d290580fa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.830940] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 in Status: UNINITIALIZED for 2s [ 1117.935237] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a0ebe90-8730-461e-a938-44165445b6de [ 1117.935475] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.935652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.935764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.936357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.936524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.936722] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a0ebe90-8730-461e-a938-44165445b6de already deleted. [ 1117.936815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a0ebe90-8730-461e-a938-44165445b6de" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.997582] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.997809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.997809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.998023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.998120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.998322] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.998422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.998486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.998649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.998719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.998807] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a already deleted. [ 1117.998902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.332814] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.333233] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.333508] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.334026] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.334338] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.334620] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 291e9d98-ac72-43f7-b745-9f0d290580fa not found, creating... [ 1118.335051] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.335332] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.335542] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.335838] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.336048] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.336403] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.336621] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.336760] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.336994] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.337162] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.337309] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 291e9d98-ac72-43f7-b745-9f0d290580fa is going to be created. [ 1118.359899] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.360328] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.360579] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.361049] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.361438] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.361795] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-291e9d98-ac72-43f7-b745-9f0d290580fa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.117225] env[62620]: INFO networking_nsxv3.common.synchronization [req-f6d62c26-136a-486f-aa78-0863907f5053 req-86d64d80-8692-48b1-afc7-a2a7b6dbf333 service nova] Enqueued Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_rules [ 1119.117225] env[62620]: INFO networking_nsxv3.common.synchronization [req-f6d62c26-136a-486f-aa78-0863907f5053 req-86d64d80-8692-48b1-afc7-a2a7b6dbf333 service nova] Enqueued Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_members [ 1119.117225] env[62620]: INFO networking_nsxv3.common.synchronization [req-f6d62c26-136a-486f-aa78-0863907f5053 req-86d64d80-8692-48b1-afc7-a2a7b6dbf333 service nova] Enqueued Resource ID: 291e9d98-ac72-43f7-b745-9f0d290580fa with Priority: HIGHEST for action port [ 1119.117225] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_rules [ 1119.117225] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_members [ 1119.117225] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 291e9d98-ac72-43f7-b745-9f0d290580fa with Priority: HIGHEST for action port [ 1119.117547] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.117706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.117774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.117995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.118057] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.118935] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.118994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.119067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.119813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.119984] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.120102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.120167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.120320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.120405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.120492] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.122234] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-291e9d98-ac72-43f7-b745-9f0d290580fa taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.122363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-291e9d98-ac72-43f7-b745-9f0d290580fa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.122431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-291e9d98-ac72-43f7-b745-9f0d290580fa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.122636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-291e9d98-ac72-43f7-b745-9f0d290580fa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.122716] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('291e9d98-ac72-43f7-b745-9f0d290580fa',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.625337] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.626385] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.626514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.626712] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 291e9d98-ac72-43f7-b745-9f0d290580fa with status ACTIVE [ 1119.626878] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.626978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.627060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.627265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.627350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.627514] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.627608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.627671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.627819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.627895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.628086] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.628193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.628243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.628377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.628446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.628529] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 291e9d98-ac72-43f7-b745-9f0d290580fa is going to be updated. [ 1119.647758] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.648547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.648547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.648547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.648547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.648547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-291e9d98-ac72-43f7-b745-9f0d290580fa" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.840599] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 in Status: SUCCESS [ 1119.840846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.840984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.841211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.841401] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.841517] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.841579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.841725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.841805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.841888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.841973] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d79c3337-b12e-40d4-993c-c4d5954de7b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.131033] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.344375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79c3337-b12e-40d4-993c-c4d5954de7b0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.345410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.345410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.345410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.345410] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.345410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.345410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.345410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.345760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.345760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.345927] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79c3337-b12e-40d4-993c-c4d5954de7b0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.345981] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.346027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.346172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.346309] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.346426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.346489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.346689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.346766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.346846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.346933] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d79c3337-b12e-40d4-993c-c4d5954de7b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.632511] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.632772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.632772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.633471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.633471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.633471] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a is going to be created. [ 1120.656364] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.656510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.656628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.656842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.657014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.665918] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a in Status: UNINITIALIZED for 2s [ 1120.849925] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d79c3337-b12e-40d4-993c-c4d5954de7b0: rpc.has_security_group_logging(os_id): False [ 1120.867438] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.867626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.867714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.867937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.868040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.868236] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.868338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.868404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.868558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.868675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.868828] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.868942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.869017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.869166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.869242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.869427] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.869520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.869582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.869722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.869795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.869879] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 is going to be created. [ 1120.926105] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.926358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.926358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.926508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.926693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.937275] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 in Status: IN_PROGRESS for 2s [ 1121.586128] env[62620]: INFO networking_nsxv3.common.synchronization [req-debd4ef2-0b41-4500-94ac-12ff129c775a req-0e4365a6-7981-4b64-aef4-31e105a45948 tempest-ServerTagsTestJSON-1489180910 tempest-ServerTagsTestJSON-1489180910-project-member] Enqueued Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGHEST for action security_group_members [ 1121.586709] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGHEST for action security_group_members [ 1121.587033] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202a637-704d-4648-b15e-1c9cbe21b05b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.587156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.587220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.587560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.587636] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.587724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.587769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.587914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.588041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.588094] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202a637-704d-4648-b15e-1c9cbe21b05b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.908790] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.909147] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-563" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.909147] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-563" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.909496] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-563" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.909761] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.909931] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.911145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.912144] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.912315] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.912537] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.912662] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.912782] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.912899] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.913065] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.913156] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.913853] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.931814] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.931998] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1121.932183] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.932359] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-563" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.932675] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-772cf7cb-3d85-4d24-a40d-d294b5f5c582 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.932852] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-772cf7cb-3d85-4d24-a40d-d294b5f5c582" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.932977] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-772cf7cb-3d85-4d24-a40d-d294b5f5c582" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.933330] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-772cf7cb-3d85-4d24-a40d-d294b5f5c582" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.933479] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('772cf7cb-3d85-4d24-a40d-d294b5f5c582',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.090347] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.090528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.090593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.090790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.090901] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.091086] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.091193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.091267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.091401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.091475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.091538] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202a637-704d-4648-b15e-1c9cbe21b05b already deleted. [ 1122.091611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.435511] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.435831] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.435912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.436305] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.436441] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.436698] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 772cf7cb-3d85-4d24-a40d-d294b5f5c582 not found, creating... [ 1122.437021] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.437215] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.437341] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.437617] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.437849] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.438286] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.438568] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.438910] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.439239] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.439407] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.439595] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 772cf7cb-3d85-4d24-a40d-d294b5f5c582 is going to be created. [ 1122.459828] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.459828] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.460141] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.460276] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.460526] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.462892] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-772cf7cb-3d85-4d24-a40d-d294b5f5c582" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.674775] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a in Status: SUCCESS [ 1122.675017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.675181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.675400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.675591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.675704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.675766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.675920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.675999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.676096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.676186] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.950943] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 in Status: SUCCESS [ 1122.951251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.178062] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.205388] env[62620]: INFO networking_nsxv3.common.synchronization [req-debd4ef2-0b41-4500-94ac-12ff129c775a req-7f4a5d84-a400-48dd-865a-d70e6cc01e31 service nova] Enqueued Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGHEST for action security_group_rules [ 1123.205569] env[62620]: INFO networking_nsxv3.common.synchronization [req-debd4ef2-0b41-4500-94ac-12ff129c775a req-7f4a5d84-a400-48dd-865a-d70e6cc01e31 service nova] Enqueued Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGHEST for action security_group_members [ 1123.205716] env[62620]: INFO networking_nsxv3.common.synchronization [req-debd4ef2-0b41-4500-94ac-12ff129c775a req-7f4a5d84-a400-48dd-865a-d70e6cc01e31 service nova] Enqueued Resource ID: 772cf7cb-3d85-4d24-a40d-d294b5f5c582 with Priority: HIGHEST for action port [ 1123.206208] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGHEST for action security_group_rules [ 1123.206343] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGHEST for action security_group_members [ 1123.206441] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 772cf7cb-3d85-4d24-a40d-d294b5f5c582 with Priority: HIGHEST for action port [ 1123.206776] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d202a637-704d-4648-b15e-1c9cbe21b05b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.206889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.206990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.207237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.207317] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d202a637-704d-4648-b15e-1c9cbe21b05b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.208144] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202a637-704d-4648-b15e-1c9cbe21b05b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.208258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.208324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.208487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.208635] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.209098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.209171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.209324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.209411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.209501] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202a637-704d-4648-b15e-1c9cbe21b05b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.210208] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-772cf7cb-3d85-4d24-a40d-d294b5f5c582 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.210315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-772cf7cb-3d85-4d24-a40d-d294b5f5c582" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.210382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-772cf7cb-3d85-4d24-a40d-d294b5f5c582" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.210532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-772cf7cb-3d85-4d24-a40d-d294b5f5c582" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.210605] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('772cf7cb-3d85-4d24-a40d-d294b5f5c582',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.681211] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78b0a132-e0e8-49ae-9afc-c9f27fc1456a: rpc.has_security_group_logging(os_id): False [ 1123.683697] env[62620]: INFO networking_nsxv3.common.synchronization [req-3227421b-d2da-4f82-988b-120f5dddf6b7 req-c40a8576-a65b-4333-9092-ecdc39d5745c tempest-ServersV294TestFqdnHostnames-171705297 tempest-ServersV294TestFqdnHostnames-171705297-project-member] Enqueued Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_members [ 1123.686963] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGHEST for action security_group_members [ 1123.686963] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.686963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.686963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.687511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.687511] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.687511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.687511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.687738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.687738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.687877] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.700608] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.700927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.700927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.701234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.701357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.701708] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.701858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.701944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.702962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.702962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.702962] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a is going to be created. [ 1123.711796] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d202a637-704d-4648-b15e-1c9cbe21b05b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.712760] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202a637-704d-4648-b15e-1c9cbe21b05b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.715996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.715996] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 772cf7cb-3d85-4d24-a40d-d294b5f5c582 with status ACTIVE [ 1123.715996] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.715996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.715996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.716690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.716690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.716690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.716690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.716690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.716690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.717125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.717125] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.717125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.717125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.717304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.717336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.718066] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 772cf7cb-3d85-4d24-a40d-d294b5f5c582 is going to be updated. [ 1123.735479] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.735687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.735687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.735902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.736175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.736254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-772cf7cb-3d85-4d24-a40d-d294b5f5c582" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.766008] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.766548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.766548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.766548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.766963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.777716] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a in Status: IN_PROGRESS for 2s [ 1123.987385] env[62620]: INFO networking_nsxv3.common.synchronization [req-2e231986-d7d5-468a-a830-7f5074a5a628 req-d448bb33-bbff-4ace-8fec-eaf8a4fca24f tempest-ServersNegativeTestJSON-470999703 tempest-ServersNegativeTestJSON-470999703-project-member] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1123.987936] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1123.988664] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.988664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.988664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.989213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.989688] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.989825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.989886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.990076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.990173] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.990269] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.190139] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.190395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.190491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.190784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.190906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.191147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.191269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.191340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.191612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.191681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.191791] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a is going to be updated. [ 1124.214574] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d202a637-704d-4648-b15e-1c9cbe21b05b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.219984] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.220360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.220360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.220687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.220935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.230359] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a in Status: IN_PROGRESS for 2s [ 1124.350343] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.350630] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.350843] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.351264] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.351600] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.351794] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.351939] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.352228] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.352435] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.352699] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.352828] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.352967] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.353123] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.353263] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.353411] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.353641] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.405423] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.405423] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1124.405423] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.405423] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.405423] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-823150e9-f3ee-44ab-a36b-c8abdca8b70e taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.405423] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.405423] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.405423] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.405423] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('823150e9-f3ee-44ab-a36b-c8abdca8b70e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.494279] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.494279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.494982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.494982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.494982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.495273] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.495273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.495380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.495574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.495647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.495696] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 already deleted. [ 1124.495805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.722022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.722022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.722022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.722022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.722022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.722022] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202a637-704d-4648-b15e-1c9cbe21b05b is going to be created. [ 1124.741992] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.742179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.742252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.742527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.742722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.752320] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202a637-704d-4648-b15e-1c9cbe21b05b in Status: UNINITIALIZED for 2s [ 1124.908867] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.909094] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.909232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.909518] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.909676] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.909838] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 823150e9-f3ee-44ab-a36b-c8abdca8b70e not found, creating... [ 1124.910124] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.910290] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.910414] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.910641] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.910785] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.911081] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.911266] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.911389] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.911603] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.911742] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.911887] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 823150e9-f3ee-44ab-a36b-c8abdca8b70e is going to be created. [ 1124.931594] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.931594] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.931594] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.931941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.932167] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.932291] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1125.645062] env[62620]: INFO networking_nsxv3.common.synchronization [req-2e231986-d7d5-468a-a830-7f5074a5a628 req-d2b4e838-a4e8-447e-a319-937bd4fb621e service nova] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_rules [ 1125.645356] env[62620]: INFO networking_nsxv3.common.synchronization [req-2e231986-d7d5-468a-a830-7f5074a5a628 req-d2b4e838-a4e8-447e-a319-937bd4fb621e service nova] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1125.645395] env[62620]: INFO networking_nsxv3.common.synchronization [req-2e231986-d7d5-468a-a830-7f5074a5a628 req-d2b4e838-a4e8-447e-a319-937bd4fb621e service nova] Enqueued Resource ID: 823150e9-f3ee-44ab-a36b-c8abdca8b70e with Priority: HIGHEST for action port [ 1125.645682] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_rules [ 1125.645820] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1125.645917] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823150e9-f3ee-44ab-a36b-c8abdca8b70e with Priority: HIGHEST for action port [ 1125.646508] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.646667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1125.646731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.646996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1125.647095] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.647920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.648043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1125.648126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.648806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1125.648806] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.648806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1125.648806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.648806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1125.648806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1125.649122] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.649899] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-823150e9-f3ee-44ab-a36b-c8abdca8b70e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.650032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1125.650083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.652322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1125.652322] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('823150e9-f3ee-44ab-a36b-c8abdca8b70e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.791040] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a in Status: SUCCESS [ 1125.792303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.152505] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.152715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1126.153030] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.153965] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 823150e9-f3ee-44ab-a36b-c8abdca8b70e with status ACTIVE [ 1126.154754] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.154754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1126.154754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.154754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1126.154754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.155023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.155023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1126.155142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.155367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1126.155468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.155734] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.155869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1126.155953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.156140] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1126.156244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.156335] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 823150e9-f3ee-44ab-a36b-c8abdca8b70e is going to be updated. [ 1126.176766] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.176958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1126.177037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.177234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1126.177375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.177540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.240797] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a in Status: SUCCESS [ 1126.240993] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a deletion is rescheduled due to dependency. [ 1126.241056] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.658659] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.761465] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202a637-704d-4648-b15e-1c9cbe21b05b in Status: SUCCESS [ 1126.761719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.761916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.762534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1126.762534] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.762534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1126.762534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.762897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1126.762897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.762897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.762897] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d202a637-704d-4648-b15e-1c9cbe21b05b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.161107] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.161314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.161620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.161620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.161620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.161789] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be created. [ 1127.191684] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.191684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.191684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.191886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.191886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.204240] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: UNINITIALIZED for 2s [ 1127.265943] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202a637-704d-4648-b15e-1c9cbe21b05b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.265943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.265943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.265943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.265943] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.265943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.265943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.265943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.266604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.266604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.266604] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202a637-704d-4648-b15e-1c9cbe21b05b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.266604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.266604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.266604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.267101] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.267101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.267101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.267101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.267395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.267395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.267395] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d202a637-704d-4648-b15e-1c9cbe21b05b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.325921] env[62620]: INFO networking_nsxv3.common.synchronization [req-e128358a-b5ef-4890-baba-79a87fa7ecd0 req-f6ca3f39-0ef7-4eb2-a4e9-19148e1a0523 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_members [ 1127.326472] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_members [ 1127.326818] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.326970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.327159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.327470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.327640] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.327762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.327853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.328017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.328131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.328217] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.770200] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d202a637-704d-4648-b15e-1c9cbe21b05b: rpc.has_security_group_logging(os_id): False [ 1127.799933] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.800106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.800179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.800395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.800489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.800683] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.800777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.800836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.800986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.801076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.801259] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.801353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.801413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.801550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.801645] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.801941] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.802388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.802561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.802777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.802777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.803049] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d202a637-704d-4648-b15e-1c9cbe21b05b is going to be created. [ 1127.830201] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.830391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.830452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.830690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.830788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.831020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.831172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.831239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.831398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.831471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.831607] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 already deleted. [ 1127.831679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.903118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.903118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.903118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.903118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.903118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.917845] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.917845] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.917845] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.918143] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.918459] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.918745] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.918966] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.919350] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.919687] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.920061] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.920284] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.920503] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.920721] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.920947] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.921171] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.921435] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.924119] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d202a637-704d-4648-b15e-1c9cbe21b05b in Status: IN_PROGRESS for 2s [ 1127.944022] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.944022] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.944022] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.944022] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.944022] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-9db88239-0a75-4952-8e09-6a6636c9ecb0 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.944022] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-9db88239-0a75-4952-8e09-6a6636c9ecb0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.944022] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-9db88239-0a75-4952-8e09-6a6636c9ecb0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.944934] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-9db88239-0a75-4952-8e09-6a6636c9ecb0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.945852] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9db88239-0a75-4952-8e09-6a6636c9ecb0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.313051] env[62620]: INFO networking_nsxv3.common.synchronization [req-240ee51e-d42f-41de-b2ff-c1d5dfad2b9b req-c40cb71a-06cb-4b1f-a9f4-06920b30056c tempest-InstanceActionsV221TestJSON-1439412738 tempest-InstanceActionsV221TestJSON-1439412738-project-member] Enqueued Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGHEST for action security_group_members [ 1128.313830] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGHEST for action security_group_members [ 1128.314173] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79c3337-b12e-40d4-993c-c4d5954de7b0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.314676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.314756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.314970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.315200] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.315384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.315490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.315661] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.315753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.315850] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79c3337-b12e-40d4-993c-c4d5954de7b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.448184] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.448455] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.448602] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.448914] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.449100] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.449271] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 9db88239-0a75-4952-8e09-6a6636c9ecb0 not found, creating... [ 1128.449544] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.449709] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.449835] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.450080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.450226] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.450543] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.450722] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.450861] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.451122] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.451265] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.451413] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 9db88239-0a75-4952-8e09-6a6636c9ecb0 is going to be created. [ 1128.472100] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.472100] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.472100] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.472100] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.472493] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.472574] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-9db88239-0a75-4952-8e09-6a6636c9ecb0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.820030] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.820634] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.820634] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.821522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.822300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.822625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.822751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.822828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.823034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.823286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.823403] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 is going to be updated. [ 1128.849541] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.849541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.849541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.849826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.849994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.858701] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 in Status: IN_PROGRESS for 2s [ 1129.216359] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1129.216644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.216912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.217237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.217508] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.217688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.217808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.218059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.218207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.218353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.218498] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.386288] env[62620]: INFO networking_nsxv3.common.synchronization [req-e128358a-b5ef-4890-baba-79a87fa7ecd0 req-eed3f355-3aad-41b9-a160-ea0d3c0a0035 service nova] Enqueued Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_rules [ 1129.386483] env[62620]: INFO networking_nsxv3.common.synchronization [req-e128358a-b5ef-4890-baba-79a87fa7ecd0 req-eed3f355-3aad-41b9-a160-ea0d3c0a0035 service nova] Enqueued Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_members [ 1129.387070] env[62620]: INFO networking_nsxv3.common.synchronization [req-e128358a-b5ef-4890-baba-79a87fa7ecd0 req-eed3f355-3aad-41b9-a160-ea0d3c0a0035 service nova] Enqueued Resource ID: 9db88239-0a75-4952-8e09-6a6636c9ecb0 with Priority: HIGHEST for action port [ 1129.387070] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_rules [ 1129.387070] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_members [ 1129.387214] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9db88239-0a75-4952-8e09-6a6636c9ecb0 with Priority: HIGHEST for action port [ 1129.389252] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.389252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.389252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.390015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.390091] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.392163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.392284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.392738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.392738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.392738] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.393716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.393716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.393716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.393716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.393716] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.394719] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-9db88239-0a75-4952-8e09-6a6636c9ecb0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.394838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9db88239-0a75-4952-8e09-6a6636c9ecb0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.394906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9db88239-0a75-4952-8e09-6a6636c9ecb0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.395152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9db88239-0a75-4952-8e09-6a6636c9ecb0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.395229] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9db88239-0a75-4952-8e09-6a6636c9ecb0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.721161] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.721263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.721538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.721538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.721719] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.721829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.726272] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.726272] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.726272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.726272] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.728028] env[62620]: INFO networking_nsxv3.common.synchronization [req-9fcfc15f-cf73-467a-9265-f815b0158b94 req-09eea9d3-d3a9-4aac-8af1-9f1358e8da48 tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1129.728696] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1129.729891] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.729891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.729891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.729891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.729891] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.729891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.729891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.730378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.730378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.730378] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.897243] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.897609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.897651] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.898600] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9db88239-0a75-4952-8e09-6a6636c9ecb0 with status ACTIVE [ 1129.898826] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.898972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.899097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.899341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.899468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.899678] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.899847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.899956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.901607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.901735] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.901970] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.902357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.902431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.902629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.902751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.902883] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9db88239-0a75-4952-8e09-6a6636c9ecb0 is going to be updated. [ 1129.924065] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.924065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.924065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.924065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.924065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.924065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9db88239-0a75-4952-8e09-6a6636c9ecb0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.940567] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d202a637-704d-4648-b15e-1c9cbe21b05b in Status: SUCCESS [ 1129.941308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.229262] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c76585c-33d4-4740-aca6-cc740735e2c9: rpc.has_security_group_logging(os_id): False [ 1130.232996] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.233161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.233204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.233411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.233494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.234653] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.234653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.234653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.234653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.234653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.234653] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1130.248681] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.248863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.248915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.249149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.249201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.249383] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.249486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.249545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.249695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.249774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.249957] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.250073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.250128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.250270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.250347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.250538] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.250623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.250695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.250827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.250903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.250983] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be created. [ 1130.261013] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.262756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.262840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.263059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.263222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.271732] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1130.317209] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.317425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.317547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.317850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.318134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.330743] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: IN_PROGRESS for 2s [ 1130.404298] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.404298] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.404298] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.404574] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.404890] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.405133] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.405388] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.406075] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.406445] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.406639] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.406822] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.406949] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.409476] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.409476] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.409476] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.409476] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.409476] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.448559] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.448757] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1130.448895] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.449885] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-566" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.450361] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-9297477b-3156-43b7-b7ca-4c2d76609f24 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.450572] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-9297477b-3156-43b7-b7ca-4c2d76609f24" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.450708] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-9297477b-3156-43b7-b7ca-4c2d76609f24" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.451230] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-9297477b-3156-43b7-b7ca-4c2d76609f24" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.451398] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9297477b-3156-43b7-b7ca-4c2d76609f24',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.563277] env[62620]: INFO networking_nsxv3.common.synchronization [req-24305e20-8d8a-4184-b925-0809cfcd3e70 req-ac72ca38-2c31-459c-8eb2-6ffa57f5bacb tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1130.564025] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1130.564357] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.564494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.564562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.564769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.564928] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.565723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.565874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.566105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.566228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.566350] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.868782] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 in Status: SUCCESS [ 1130.869132] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 deletion is rescheduled due to dependency. [ 1130.869306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.911973] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.912311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.912311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.912479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.912572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.912673] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 is going to be created. [ 1130.933717] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.933886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.933942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.934168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.934332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.942812] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 in Status: UNINITIALIZED for 2s [ 1130.953518] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.953739] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.953884] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.954173] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.954330] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.954489] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 9297477b-3156-43b7-b7ca-4c2d76609f24 not found, creating... [ 1130.954843] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.955097] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.955288] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.955656] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.955814] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.956172] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.956358] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.956486] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.956736] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.956872] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.957112] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 9297477b-3156-43b7-b7ca-4c2d76609f24 is going to be created. [ 1130.976984] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.977355] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.977480] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.977833] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.978115] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.978371] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-9297477b-3156-43b7-b7ca-4c2d76609f24" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.071564] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.071785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.071785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.072020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.072115] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.072348] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.072470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.072534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.072710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.072790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.072889] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1131.106898] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.107116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.107116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.107384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.107526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.115957] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1131.755430] env[62620]: INFO networking_nsxv3.common.synchronization [req-9fcfc15f-cf73-467a-9265-f815b0158b94 req-8362678d-5150-4765-9790-34e0ec2bdc7e service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 1131.755614] env[62620]: INFO networking_nsxv3.common.synchronization [req-9fcfc15f-cf73-467a-9265-f815b0158b94 req-8362678d-5150-4765-9790-34e0ec2bdc7e service nova] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1131.755759] env[62620]: INFO networking_nsxv3.common.synchronization [req-9fcfc15f-cf73-467a-9265-f815b0158b94 req-8362678d-5150-4765-9790-34e0ec2bdc7e service nova] Enqueued Resource ID: 9297477b-3156-43b7-b7ca-4c2d76609f24 with Priority: HIGHEST for action port [ 1131.757030] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_rules [ 1131.757202] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1131.757324] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9297477b-3156-43b7-b7ca-4c2d76609f24 with Priority: HIGHEST for action port [ 1131.758125] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.758217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.758292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.758493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.758576] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.759388] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.759482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.759668] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-9297477b-3156-43b7-b7ca-4c2d76609f24 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.759825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9297477b-3156-43b7-b7ca-4c2d76609f24" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.759825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9297477b-3156-43b7-b7ca-4c2d76609f24" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.760134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9297477b-3156-43b7-b7ca-4c2d76609f24" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.760134] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9297477b-3156-43b7-b7ca-4c2d76609f24',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.262971] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9297477b-3156-43b7-b7ca-4c2d76609f24 with status ACTIVE [ 1132.263311] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.263413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.263482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.263724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.263817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.263994] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.264112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.264177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.264329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.264430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.264581] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.264746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.264820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.264954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.265048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.265132] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9297477b-3156-43b7-b7ca-4c2d76609f24 is going to be updated. [ 1132.270986] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.271118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.286618] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1132.286618] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 1132.286618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.286618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.286618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.286618] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.286618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.287248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.287248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.292545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.292607] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.305524] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.305784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.305917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.306263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.306565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.306826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9297477b-3156-43b7-b7ca-4c2d76609f24" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.344051] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1132.344295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.795755] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.955290] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 in Status: SUCCESS [ 1132.955290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.955290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.955290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.955290] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.955290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.955290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.955290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.955290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.955290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.955290] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.129090] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1133.129353] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c deletion is rescheduled due to dependency. [ 1133.129477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.298363] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.457380] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.801597] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.801761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.801892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.802349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.802461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.802567] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1133.844422] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.844657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.844657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.844926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.845089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.854163] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1133.946565] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1133.946844] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1133.961084] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 098dac2c-8d52-48ba-bfe3-5e87aaad5495: rpc.has_security_group_logging(os_id): False [ 1133.980077] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.980280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.980327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.980528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.980612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.982068] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.982068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.982068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.982333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.982333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.982333] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 is going to be created. [ 1134.039829] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.040450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.040623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.040965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.041484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.054079] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 in Status: IN_PROGRESS for 2s [ 1135.298392] env[62620]: INFO networking_nsxv3.common.synchronization [req-02b66e4a-06ca-41b3-82cb-7d2220ca7ca9 req-3abd5409-be44-43bc-99f8-edddb3c5a0fd tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1135.299615] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1135.300051] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.300237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.300344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.300621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.300871] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.301016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.301132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.301372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.301532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.301678] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.687109] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.687333] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.687489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.687744] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.688180] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.689163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.689163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.689163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.689163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.689347] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.689639] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.689639] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.689734] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.689937] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.689973] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.690259] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.711372] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.711372] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1135.711372] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.711372] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.711372] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-b8c79070-6650-4427-ab59-c910dccfba54 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.711372] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-b8c79070-6650-4427-ab59-c910dccfba54" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.711372] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-b8c79070-6650-4427-ab59-c910dccfba54" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.711372] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-b8c79070-6650-4427-ab59-c910dccfba54" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.711697] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c79070-6650-4427-ab59-c910dccfba54',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.807012] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.807307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.807307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.807486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.807575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.808486] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.809078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.809078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.809220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.809253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.810528] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be deleted. [ 1135.835595] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.835754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.835808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.836047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.836145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.836246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.867702] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1135.867702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.867702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.867702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.867702] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.867702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.867702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.867702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.867702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.867702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.867702] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.022706] env[62620]: INFO networking_nsxv3.common.synchronization [req-761becfe-42d0-427d-bb4a-371c297cadf1 req-2c64b632-d08b-43f2-8d6f-061e1de18e1e tempest-ServerTagsTestJSON-1489180910 tempest-ServerTagsTestJSON-1489180910-project-member] Enqueued Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGHEST for action security_group_members [ 1136.022706] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGHEST for action security_group_members [ 1136.022706] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-d202a637-704d-4648-b15e-1c9cbe21b05b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.022706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.022706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.023368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.023784] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.024091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.024464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.026326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.026326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.026326] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d202a637-704d-4648-b15e-1c9cbe21b05b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.066590] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 in Status: SUCCESS [ 1136.066887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.133095] env[62620]: INFO networking_nsxv3.common.synchronization [None req-dad38dc6-cb29-4b93-a71b-1f8a051897a7 None None] Enqueued Resource ID: 7c6368cc-fc2b-4300-abfd-4dfcf9a23a86 with Priority: HIGHEST for action port [ 1136.133370] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6368cc-fc2b-4300-abfd-4dfcf9a23a86 with Priority: HIGHEST for action port [ 1136.133999] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c6368cc-fc2b-4300-abfd-4dfcf9a23a86 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.135569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c6368cc-fc2b-4300-abfd-4dfcf9a23a86" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.135636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c6368cc-fc2b-4300-abfd-4dfcf9a23a86" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.135904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c6368cc-fc2b-4300-abfd-4dfcf9a23a86" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.136010] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c6368cc-fc2b-4300-abfd-4dfcf9a23a86',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.214722] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.214921] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.215064] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.215287] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.215489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.215682] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port b8c79070-6650-4427-ab59-c910dccfba54 not found, creating... [ 1136.215974] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.216168] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.216314] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.216597] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.216806] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.217136] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.217315] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.217442] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.217679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.217851] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.218030] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: b8c79070-6650-4427-ab59-c910dccfba54 is going to be created. [ 1136.238163] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.238163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.238163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.238163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.238426] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.238613] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-b8c79070-6650-4427-ab59-c910dccfba54" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.372629] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.372895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.372895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.373071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.373737] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.373862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.373932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.374162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.374264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.374359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.374522] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.374620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.374683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.374859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.375010] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.375109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.375170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.375314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.375392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.375582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.375582] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.529286] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.529428] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.529487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.529702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.529794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.529997] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.530201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.530283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.530429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.530505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.530596] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202a637-704d-4648-b15e-1c9cbe21b05b is going to be updated. [ 1136.555832] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.556086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.556086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.556354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.556507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.564052] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202a637-704d-4648-b15e-1c9cbe21b05b in Status: IN_PROGRESS for 2s [ 1136.638477] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c6368cc-fc2b-4300-abfd-4dfcf9a23a86 [ 1136.638747] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.639050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.639050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.639269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.639364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.639469] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c6368cc-fc2b-4300-abfd-4dfcf9a23a86 already deleted. [ 1136.639559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c6368cc-fc2b-4300-abfd-4dfcf9a23a86" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.880772] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c469d6d-346a-40a2-adb5-8c50f7758224: rpc.has_security_group_logging(os_id): False [ 1136.898821] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.899053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.899172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.899466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.900277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.900517] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.901800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.901800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.901800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.901800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.901800] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.902310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.902310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.902310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.902310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.902871] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.902871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.902871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.903056] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.903092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.903668] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1136.971531] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.971729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.971820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.972063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.972840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.988655] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1137.229307] env[62620]: INFO networking_nsxv3.common.synchronization [None req-35add0c0-61b9-43bc-ab7f-5ba679a9bb55 tempest-ServerActionsV293TestJSON-856706501 tempest-ServerActionsV293TestJSON-856706501-project-member] Enqueued Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_rules [ 1137.229307] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_rules [ 1137.229307] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20781892-13fd-4ddf-8c97-ac90186655e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.230399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.232936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.232936] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.232936] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.241150] env[62620]: INFO networking_nsxv3.common.synchronization [req-3edc68b0-aa09-4fb3-972a-ac9b7ead33ed req-1450b198-78ea-4a7a-b582-d381d503ef9b tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1137.243016] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1137.243016] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.243016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.243016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.243016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.243016] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.243016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.243016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.244641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.246493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.246493] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.351125] env[62620]: INFO networking_nsxv3.common.synchronization [None req-9f4f57cd-6fcb-49b7-b4e6-146725145407 tempest-ServerActionsV293TestJSON-856706501 tempest-ServerActionsV293TestJSON-856706501-project-member] Enqueued Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_rules [ 1137.351702] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_rules [ 1137.352213] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20781892-13fd-4ddf-8c97-ac90186655e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.352213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.370022] env[62620]: INFO networking_nsxv3.common.synchronization [req-02b66e4a-06ca-41b3-82cb-7d2220ca7ca9 req-ce4e57f1-aa50-4f61-a33d-5f92921f898d service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 1137.370022] env[62620]: INFO networking_nsxv3.common.synchronization [req-02b66e4a-06ca-41b3-82cb-7d2220ca7ca9 req-ce4e57f1-aa50-4f61-a33d-5f92921f898d service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1137.370022] env[62620]: INFO networking_nsxv3.common.synchronization [req-02b66e4a-06ca-41b3-82cb-7d2220ca7ca9 req-ce4e57f1-aa50-4f61-a33d-5f92921f898d service nova] Enqueued Resource ID: b8c79070-6650-4427-ab59-c910dccfba54 with Priority: HIGHEST for action port [ 1137.370022] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 1137.370022] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1137.370022] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c79070-6650-4427-ab59-c910dccfba54 with Priority: HIGHEST for action port [ 1137.370022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.370022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.370022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.370022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.370022] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.371774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.373294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.373294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.373294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.373294] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.373294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.375595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.375595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.375595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.375595] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.376486] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8c79070-6650-4427-ab59-c910dccfba54 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.376703] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8c79070-6650-4427-ab59-c910dccfba54" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.376703] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8c79070-6650-4427-ab59-c910dccfba54" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.376906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8c79070-6650-4427-ab59-c910dccfba54" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.380792] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c79070-6650-4427-ab59-c910dccfba54',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.623064] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.623333] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.623493] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.623815] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.624331] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.624573] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.624765] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.625109] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.625338] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.625649] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.625839] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.626547] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.626746] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.626997] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.627188] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.627389] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.645007] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.645810] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1137.645986] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.646200] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.646527] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-9830a1ce-942e-4954-8513-f624e13d304c taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.646708] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-9830a1ce-942e-4954-8513-f624e13d304c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.646868] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-9830a1ce-942e-4954-8513-f624e13d304c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.647222] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-9830a1ce-942e-4954-8513-f624e13d304c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.647372] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9830a1ce-942e-4954-8513-f624e13d304c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.747530] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.747530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.747530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.747713] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.747833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.748049] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.748153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.748216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.748406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.748453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.748536] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1137.751487] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.751603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.753975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.753975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.753975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.753975] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20781892-13fd-4ddf-8c97-ac90186655e0 already deleted. [ 1137.753975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.753975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.753975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.753975] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.772717] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.772717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.772810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.772971] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.773135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.789356] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1137.882378] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.883903] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.883995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.884801] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8c79070-6650-4427-ab59-c910dccfba54 with status ACTIVE [ 1137.884801] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.884801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.884917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.885050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.885147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.885328] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.885602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.886175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.886175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.886175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.886175] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.886364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.886364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.886635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.886834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.886951] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8c79070-6650-4427-ab59-c910dccfba54 is going to be updated. [ 1137.914440] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.914811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.914811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.915083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.915314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.915567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8c79070-6650-4427-ab59-c910dccfba54" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.150447] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.150683] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.150838] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.151174] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.151348] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.151491] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 9830a1ce-942e-4954-8513-f624e13d304c not found, creating... [ 1138.151752] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.151918] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.152055] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.152881] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.152881] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.152881] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.152881] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.153108] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.153379] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.153554] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.153736] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 9830a1ce-942e-4954-8513-f624e13d304c is going to be created. [ 1138.170738] env[62620]: INFO networking_nsxv3.common.synchronization [None req-8f59dec4-16ce-4d26-acad-16f5a22d80e7 None None] Enqueued Resource ID: f0359923-3ba6-4e07-9b4b-02ae3078d197 with Priority: HIGHEST for action port [ 1138.172611] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0359923-3ba6-4e07-9b4b-02ae3078d197 with Priority: HIGHEST for action port [ 1138.173831] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.174038] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.174251] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.174442] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.174687] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.174923] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-9830a1ce-942e-4954-8513-f624e13d304c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.175769] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0359923-3ba6-4e07-9b4b-02ae3078d197 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.175887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0359923-3ba6-4e07-9b4b-02ae3078d197" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.175955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0359923-3ba6-4e07-9b4b-02ae3078d197" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.176187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0359923-3ba6-4e07-9b4b-02ae3078d197" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.176261] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0359923-3ba6-4e07-9b4b-02ae3078d197',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.273492] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.273671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.273743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.274235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.274371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.274465] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20781892-13fd-4ddf-8c97-ac90186655e0 already deleted. [ 1138.274548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.389515] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.573519] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d202a637-704d-4648-b15e-1c9cbe21b05b in Status: SUCCESS [ 1138.573795] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d202a637-704d-4648-b15e-1c9cbe21b05b deletion is rescheduled due to dependency. [ 1138.573920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.681514] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0359923-3ba6-4e07-9b4b-02ae3078d197 [ 1138.681514] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.681514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.681514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.681514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.681514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.681514] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0359923-3ba6-4e07-9b4b-02ae3078d197 already deleted. [ 1138.681514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0359923-3ba6-4e07-9b4b-02ae3078d197" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.893917] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.893917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.893917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.893917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.893917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.893917] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be created. [ 1138.916859] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.916859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.916859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.916859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.916859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.926019] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: UNINITIALIZED for 2s [ 1139.005120] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1139.005441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.082556] env[62620]: INFO networking_nsxv3.common.synchronization [req-3edc68b0-aa09-4fb3-972a-ac9b7ead33ed req-364d7a5f-5549-40e3-b75d-10bf537218e7 service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1139.082742] env[62620]: INFO networking_nsxv3.common.synchronization [req-3edc68b0-aa09-4fb3-972a-ac9b7ead33ed req-364d7a5f-5549-40e3-b75d-10bf537218e7 service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1139.082888] env[62620]: INFO networking_nsxv3.common.synchronization [req-3edc68b0-aa09-4fb3-972a-ac9b7ead33ed req-364d7a5f-5549-40e3-b75d-10bf537218e7 service nova] Enqueued Resource ID: 9830a1ce-942e-4954-8513-f624e13d304c with Priority: HIGHEST for action port [ 1139.083148] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1139.083290] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1139.083409] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9830a1ce-942e-4954-8513-f624e13d304c with Priority: HIGHEST for action port [ 1139.083978] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.084237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.084309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.084516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.084598] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.085471] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.085572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.085764] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-9830a1ce-942e-4954-8513-f624e13d304c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.085860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9830a1ce-942e-4954-8513-f624e13d304c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.085940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9830a1ce-942e-4954-8513-f624e13d304c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.086122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9830a1ce-942e-4954-8513-f624e13d304c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.087394] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9830a1ce-942e-4954-8513-f624e13d304c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.588932] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.589310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.589310] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9830a1ce-942e-4954-8513-f624e13d304c with status ACTIVE [ 1139.589446] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.589629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.589629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.589829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.589906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.590170] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.590170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.590364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.590415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.590464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.590659] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.590755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.590808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.590962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.591035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.591723] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9830a1ce-942e-4954-8513-f624e13d304c is going to be updated. [ 1139.611212] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.611493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.611602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.611810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.611979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.612192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9830a1ce-942e-4954-8513-f624e13d304c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.801031] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1139.801031] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c deletion is rescheduled due to dependency. [ 1139.801031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.801031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.801031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.801327] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.801327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.801327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.801861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.801861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.801861] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.303676] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.584601] env[62620]: INFO networking_nsxv3.common.synchronization [req-6d0287b8-3a63-43bf-9e20-f85b0d12c9c5 req-feb5a275-b028-4849-b062-3043228f9666 tempest-ServersNegativeTestJSON-470999703 tempest-ServersNegativeTestJSON-470999703-project-member] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1140.585137] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1140.585448] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.585573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.585643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.585847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.586021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.586118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.586197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.586327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.586404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.586501] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.808262] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.900357] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.900578] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.900725] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.901088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.901376] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.901569] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.901713] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.901973] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.902169] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.902416] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.902621] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.902747] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.902879] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.903014] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.903149] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.903942] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.922944] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.923997] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1140.923997] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.923997] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.923997] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-37591ab2-0826-44b0-99ae-03059115c799 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.924297] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-37591ab2-0826-44b0-99ae-03059115c799" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.924449] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-37591ab2-0826-44b0-99ae-03059115c799" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.924856] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-37591ab2-0826-44b0-99ae-03059115c799" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.925038] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37591ab2-0826-44b0-99ae-03059115c799',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.934265] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1140.934265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.934534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.934614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.934810] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.934925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.934993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.935211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.935366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.935416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.935492] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.090388] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.311318] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.311519] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.311631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.311862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.311976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.312116] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1141.340708] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.340909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.340964] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.341243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.341412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.349623] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1141.427889] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.428296] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.428525] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.429111] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.429241] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.429501] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 37591ab2-0826-44b0-99ae-03059115c799 not found, creating... [ 1141.431032] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.431032] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.431032] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.431032] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.431032] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.431537] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.431775] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.431994] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.432355] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.432593] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.432850] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 37591ab2-0826-44b0-99ae-03059115c799 is going to be created. [ 1141.438414] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.438414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.438531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.438753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.438997] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.439696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.439812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.440064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.440197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.440338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.440574] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.440725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.440831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.441051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.441244] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.441370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.441456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.441656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.441816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.441990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.442192] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.453599] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.453948] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.454193] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.454542] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.454929] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.455772] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-37591ab2-0826-44b0-99ae-03059115c799" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.593042] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.944174] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20f5a061-dbd0-44d6-953b-0f455ddef899: rpc.has_security_group_logging(os_id): False [ 1141.961628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.961834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.961905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.962147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.962305] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.962645] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.962796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.962867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.963035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.963121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.963332] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.963614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.963674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.963831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.963911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.964125] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.964223] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.964280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.964426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.964501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.964585] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be created. [ 1142.018056] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.018269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.018361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.018638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.018893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.028947] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1142.095713] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.095975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.095975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.096187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.096466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.096466] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be updated. [ 1142.136460] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.136460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.136668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.136719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.136977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.158136] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: IN_PROGRESS for 2s [ 1142.229094] env[62620]: INFO networking_nsxv3.common.synchronization [req-6d0287b8-3a63-43bf-9e20-f85b0d12c9c5 req-8f8a9ae6-0276-4edf-a3dc-0b56ecc565d2 service nova] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_rules [ 1142.229305] env[62620]: INFO networking_nsxv3.common.synchronization [req-6d0287b8-3a63-43bf-9e20-f85b0d12c9c5 req-8f8a9ae6-0276-4edf-a3dc-0b56ecc565d2 service nova] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1142.229418] env[62620]: INFO networking_nsxv3.common.synchronization [req-6d0287b8-3a63-43bf-9e20-f85b0d12c9c5 req-8f8a9ae6-0276-4edf-a3dc-0b56ecc565d2 service nova] Enqueued Resource ID: 37591ab2-0826-44b0-99ae-03059115c799 with Priority: HIGHEST for action port [ 1142.231019] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_rules [ 1142.231019] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1142.231019] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37591ab2-0826-44b0-99ae-03059115c799 with Priority: HIGHEST for action port [ 1142.233486] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.233486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.233486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.233815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.233815] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.234486] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.234590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.234897] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-37591ab2-0826-44b0-99ae-03059115c799 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.234897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37591ab2-0826-44b0-99ae-03059115c799" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.235062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37591ab2-0826-44b0-99ae-03059115c799" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.235139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37591ab2-0826-44b0-99ae-03059115c799" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.235213] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37591ab2-0826-44b0-99ae-03059115c799',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.537139] env[62620]: INFO networking_nsxv3.common.synchronization [None req-861e075d-4c4e-4701-9dfb-829e59ffdef4 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1142.537651] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1142.537986] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.538125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.538189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.539273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.539436] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.539543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.539616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.539780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.539867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.539963] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.743783] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.743993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.744225] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37591ab2-0826-44b0-99ae-03059115c799 with status ACTIVE [ 1142.744384] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.744539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.745749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.746016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.746129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.746329] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.746441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.746516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.746676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.746778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.747316] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.747581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.747581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.747787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.747892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.747997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37591ab2-0826-44b0-99ae-03059115c799 is going to be updated. [ 1142.770408] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.770621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.770711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.770904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.771066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.771461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37591ab2-0826-44b0-99ae-03059115c799" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.041683] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.362164] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1143.364685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.364685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.364685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.364685] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.364685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.364685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.364685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.364685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.364685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.364685] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.544450] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.569022] env[62620]: INFO networking_nsxv3.common.synchronization [req-ba47d5df-8aec-4758-93a2-2e27eea4eb86 req-917c3054-59b3-4ccb-b5d9-24bf5fc95f95 tempest-ServersWithSpecificFlavorTestJSON-1227304686 tempest-ServersWithSpecificFlavorTestJSON-1227304686-project-member] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 1143.569022] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 1143.569022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.569022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.569022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.569022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.569757] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.569989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.571614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.571614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.571614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.571614] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.872690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.872690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.872690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.872690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.872690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.873430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.873430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.873430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.873430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.873430] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.041580] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1144.041815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.045565] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.045565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.045693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.045850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.045938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.046153] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be updated. [ 1144.072533] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.073089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.073232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.073604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.073913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.074175] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.074948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.074948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.075171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.075171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.075171] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f is going to be updated. [ 1144.080046] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.080237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.080237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.080449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.080547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.090191] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1144.112167] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.112167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.112167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.112167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.112167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.120262] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: IN_PROGRESS for 2s [ 1144.168319] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1144.168319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.168319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.168319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.168319] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.168319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.168319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.168319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.168319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.168319] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.377426] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5026804-13b5-4b49-b1b4-b00084a12c8c: rpc.has_security_group_logging(os_id): False [ 1144.392534] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.393520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.393618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.393958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.394163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.394458] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.394616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.394712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.394927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.395088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.395537] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.395537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.395670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.395846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.395937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.396277] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.396416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.396489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.396699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.396830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.396952] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1144.473679] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.473831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.473904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.474158] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.474317] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.493275] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1144.670998] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.811670] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.811910] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.812148] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.812548] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.813095] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.813278] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.813501] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.813983] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.814079] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.814351] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.814482] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.814602] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.814789] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.814907] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.815091] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.815235] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.833753] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.833923] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1144.834087] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.834272] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.834580] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-aa0a7b01-9a61-4e32-82cb-8f849bff6266 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.834773] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-aa0a7b01-9a61-4e32-82cb-8f849bff6266" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.835008] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-aa0a7b01-9a61-4e32-82cb-8f849bff6266" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.835398] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-aa0a7b01-9a61-4e32-82cb-8f849bff6266" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.835551] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa0a7b01-9a61-4e32-82cb-8f849bff6266',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.173505] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.337679] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.337950] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.338113] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.338409] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.338565] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.338729] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port aa0a7b01-9a61-4e32-82cb-8f849bff6266 not found, creating... [ 1145.339097] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.339194] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.339316] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.339550] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.339698] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.340011] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.340354] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.340488] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.340712] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.340875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.341053] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: aa0a7b01-9a61-4e32-82cb-8f849bff6266 is going to be created. [ 1145.359382] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.359596] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.359728] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.360011] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.360259] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.360494] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-aa0a7b01-9a61-4e32-82cb-8f849bff6266" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.676419] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.676639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.676741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.677040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.677147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.677301] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be updated. [ 1145.704372] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.704520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.704631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.704897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.705036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.715114] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: IN_PROGRESS for 2s [ 1146.099268] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1146.099520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.128221] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: IN_PROGRESS for 4s [ 1146.166140] env[62620]: INFO networking_nsxv3.common.synchronization [req-b1c70210-0f0c-4d59-9eaf-fb6af369ecab req-4c230340-5cef-4f37-88df-6a8d7b6a97d0 service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 1146.166411] env[62620]: INFO networking_nsxv3.common.synchronization [req-b1c70210-0f0c-4d59-9eaf-fb6af369ecab req-4c230340-5cef-4f37-88df-6a8d7b6a97d0 service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1146.166598] env[62620]: INFO networking_nsxv3.common.synchronization [req-b1c70210-0f0c-4d59-9eaf-fb6af369ecab req-4c230340-5cef-4f37-88df-6a8d7b6a97d0 service nova] Enqueued Resource ID: aa0a7b01-9a61-4e32-82cb-8f849bff6266 with Priority: HIGHEST for action port [ 1146.167726] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 1146.167916] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1146.168116] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0a7b01-9a61-4e32-82cb-8f849bff6266 with Priority: HIGHEST for action port [ 1146.168522] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.168692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.168771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.169025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.169155] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.170255] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.170348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.170385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.170616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.170808] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.170931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.171012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.171204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.171300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.171579] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.172486] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa0a7b01-9a61-4e32-82cb-8f849bff6266 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.172486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa0a7b01-9a61-4e32-82cb-8f849bff6266" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.172652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa0a7b01-9a61-4e32-82cb-8f849bff6266" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.172774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa0a7b01-9a61-4e32-82cb-8f849bff6266" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.172822] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa0a7b01-9a61-4e32-82cb-8f849bff6266',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.506045] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1146.506354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.674573] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.676726] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.676980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.678774] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa0a7b01-9a61-4e32-82cb-8f849bff6266 with status ACTIVE [ 1146.679054] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.679264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.679321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.679566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.679666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.679942] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.680086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.680166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.680379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.680504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.680801] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.680966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.681076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.681249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.681341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.681423] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa0a7b01-9a61-4e32-82cb-8f849bff6266 is going to be updated. [ 1146.701425] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.701606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.701648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.701850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.701993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.702180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa0a7b01-9a61-4e32-82cb-8f849bff6266" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.178915] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.308672] env[62620]: INFO networking_nsxv3.common.synchronization [req-44ffe4b6-057e-4e06-9d5e-f733852b7981 req-53310060-d55c-4b91-8bc2-70045b39f60e tempest-ServersWithSpecificFlavorTestJSON-1227304686 tempest-ServersWithSpecificFlavorTestJSON-1227304686-project-member] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 1147.309469] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 1147.309813] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.309945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.685017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.685017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.685017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.685017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.685017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.685017] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be updated. [ 1147.720395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.720395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.720395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.720395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.720395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.721716] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-771 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.721716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-771" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.721716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-771" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.722073] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-771" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.722773] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.722959] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.723904] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.724146] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.724315] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.725154] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.725307] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.725440] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.725565] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.725694] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.725814] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.725996] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.731114] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1147.738148] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1147.738148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.738148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.738148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.738421] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.738421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.738421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.738595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.738658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.738747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.738989] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.751208] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.751411] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1147.751567] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.751754] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-771" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.752135] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-4534e6a9-471a-4703-aa7a-7aac3d20292f taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.752326] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-4534e6a9-471a-4703-aa7a-7aac3d20292f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.752455] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-4534e6a9-471a-4703-aa7a-7aac3d20292f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.752782] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-4534e6a9-471a-4703-aa7a-7aac3d20292f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.752948] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4534e6a9-471a-4703-aa7a-7aac3d20292f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.137657] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: SUCCESS [ 1148.137936] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f deletion is rescheduled due to dependency. [ 1148.138147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.138420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.138652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.138935] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.139135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.139289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.139530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.139739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.139852] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.242711] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.242711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.242711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.242916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.243064] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.243245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.243485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.243752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.243917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.244101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.244371] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.244575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.244681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.245063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.245063] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.245232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.245232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.245413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.245575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.245643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.245757] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.255973] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.255973] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.256287] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.256414] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.256583] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.256793] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 4534e6a9-471a-4703-aa7a-7aac3d20292f not found, creating... [ 1148.257308] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.257447] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.257504] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.257790] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.258478] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.258591] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.258751] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.258927] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.259149] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.259305] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.259462] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 4534e6a9-471a-4703-aa7a-7aac3d20292f is going to be created. [ 1148.281185] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.281422] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.281572] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.281830] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.282099] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.282363] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-4534e6a9-471a-4703-aa7a-7aac3d20292f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.645750] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.645750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.645750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.645750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.645750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.645750] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.645750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.645750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.645750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.645750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.645750] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f is going to be updated. [ 1148.670916] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.670916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.670916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.670916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.670916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.677515] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: IN_PROGRESS for 2s [ 1148.751042] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c76585c-33d4-4740-aca6-cc740735e2c9: rpc.has_security_group_logging(os_id): False [ 1148.768379] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.768509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.768509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.768709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.768824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.769066] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.769199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.769268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.769456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.769532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.769739] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.769832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.769896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.770051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.770129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.770375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.770578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.770578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.770811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.770849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.770940] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be updated. [ 1148.827340] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.827522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.827522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.827780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.827927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.838789] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: IN_PROGRESS for 2s [ 1149.125983] env[62620]: INFO networking_nsxv3.common.synchronization [req-44ffe4b6-057e-4e06-9d5e-f733852b7981 req-98e17164-aa2c-4082-94b7-4d63edd1b5cb service nova] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_rules [ 1149.126190] env[62620]: INFO networking_nsxv3.common.synchronization [req-44ffe4b6-057e-4e06-9d5e-f733852b7981 req-98e17164-aa2c-4082-94b7-4d63edd1b5cb service nova] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 1149.126334] env[62620]: INFO networking_nsxv3.common.synchronization [req-44ffe4b6-057e-4e06-9d5e-f733852b7981 req-98e17164-aa2c-4082-94b7-4d63edd1b5cb service nova] Enqueued Resource ID: 4534e6a9-471a-4703-aa7a-7aac3d20292f with Priority: HIGHEST for action port [ 1149.126555] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_rules [ 1149.126686] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 1149.126785] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4534e6a9-471a-4703-aa7a-7aac3d20292f with Priority: HIGHEST for action port [ 1149.127355] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.127477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.127553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.127776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1149.127858] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.129780] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.129881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.130103] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4534e6a9-471a-4703-aa7a-7aac3d20292f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.130209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4534e6a9-471a-4703-aa7a-7aac3d20292f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.130274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4534e6a9-471a-4703-aa7a-7aac3d20292f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.130444] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4534e6a9-471a-4703-aa7a-7aac3d20292f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1149.130521] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4534e6a9-471a-4703-aa7a-7aac3d20292f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.633020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.633188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.633376] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4534e6a9-471a-4703-aa7a-7aac3d20292f with status ACTIVE [ 1149.633550] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.633669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.633720] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.633934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1149.634039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1149.634255] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.635155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.635155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.635155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1149.635155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1149.635155] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.635155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.635155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.635438] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1149.635438] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1149.635438] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4534e6a9-471a-4703-aa7a-7aac3d20292f is going to be updated. [ 1149.665114] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.665303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.665378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.665615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1149.665762] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1149.666125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4534e6a9-471a-4703-aa7a-7aac3d20292f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1149.740697] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1149.740967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1149.741226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.741533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1149.742143] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.742143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.742143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.742299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1149.742419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1149.742523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1149.742634] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.245362] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.245743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.245743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.245967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.246417] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.246417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.246520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.246724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.246820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.247105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.247197] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.247310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.247398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.247587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.247774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.248174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.248281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.248466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.248561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.248653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.248747] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.686523] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: SUCCESS [ 1150.686734] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f deletion is rescheduled due to dependency. [ 1150.687852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.687852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.687852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.687852] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.687852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.687852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.687852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.688168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.688168] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.751196] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20f5a061-dbd0-44d6-953b-0f455ddef899: rpc.has_security_group_logging(os_id): False [ 1150.771882] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.772040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.772119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.772333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.772427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.772615] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.772714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.772776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.772926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.773014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.773250] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.773330] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.773366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.773690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.773771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.773979] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.774092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.774154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.774296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.774371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.774455] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be updated. [ 1150.832118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.832327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.832437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.832726] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.833154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.848958] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1150.849287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.850198] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1151.190526] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.693304] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.195713] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.195922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1152.196015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.196352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1152.196478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1152.196599] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f is going to be updated. [ 1152.235425] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.235584] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1152.235654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.235874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1152.236039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1152.250679] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: IN_PROGRESS for 2s [ 1152.869052] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1152.869434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.128609] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1154.128609] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1154.260810] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: SUCCESS [ 1154.260810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.261076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.261203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.261944] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.262806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.262806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.262806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.263275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.263275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.263275] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.349443] env[62620]: INFO networking_nsxv3.common.synchronization [req-a3d83ed9-2251-4adf-be7e-c2086b039478 req-11e0d13f-3872-4d95-b608-f42cae43301a tempest-ServersNegativeTestJSON-470999703 tempest-ServersNegativeTestJSON-470999703-project-member] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1154.350101] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1154.350376] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.350597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.350597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.350766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.350917] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.351021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.351085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.351235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.351323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.351412] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.765446] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.853542] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.267742] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7bdbdc9-465d-491e-8f58-3f3aff4b421f: rpc.has_security_group_logging(os_id): False [ 1155.286409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.286608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.286678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.286933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.287099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.287389] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.287504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.287572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.287852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.287852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.287987] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f is going to be updated. [ 1155.353738] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.353921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.354021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.354213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.354793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.355542] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.366664] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: IN_PROGRESS for 2s [ 1155.858748] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.859121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.859210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.859518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.859637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.859785] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be updated. [ 1155.888769] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.888927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.889010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.889253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.889440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.898722] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: IN_PROGRESS for 2s [ 1157.342787] env[62620]: INFO networking_nsxv3.common.synchronization [req-c33b2cac-d408-4e3e-b98d-a8712c825232 req-f3346e14-0529-4de1-9bf7-4ef49ca47121 tempest-ServerRescueNegativeTestJSON-1339547319 tempest-ServerRescueNegativeTestJSON-1339547319-project-member] Enqueued Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_members [ 1157.343395] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGHEST for action security_group_members [ 1157.343716] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.343880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.344066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.344289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.344481] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.344597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.344658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.344849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.344989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.345149] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.384036] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: SUCCESS [ 1157.384036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.847071] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.847355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.847479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.847789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.847958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.848305] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.848500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.848604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.848831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.848977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.849160] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33d974dd-1e63-4b84-ae24-738b194f0483 is going to be updated. [ 1157.879196] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.879415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.879415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.879652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.879793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.896869] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33d974dd-1e63-4b84-ae24-738b194f0483 in Status: IN_PROGRESS for 2s [ 1157.914234] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1157.914470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1159.708708] env[62620]: INFO networking_nsxv3.common.synchronization [req-203f628b-0e72-4020-84e1-97edea347939 req-49f4d2fa-bf9f-48b6-b0a5-056e7a48f14c tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1159.708708] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1159.709098] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.709098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1159.709098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.709303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1159.709451] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.709546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1159.709607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.709757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1159.709840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1159.709930] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.908034] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33d974dd-1e63-4b84-ae24-738b194f0483 in Status: SUCCESS [ 1159.908034] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33d974dd-1e63-4b84-ae24-738b194f0483 deletion is rescheduled due to dependency. [ 1159.908034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1160.212675] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.288314] env[62620]: INFO networking_nsxv3.common.synchronization [None req-7133405d-372f-4327-8cc1-acbe4ac0bd7f tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1160.288885] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1160.289281] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.289424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1160.715420] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.218566] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.218827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1161.219008] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.219266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1161.219488] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1161.219645] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be updated. [ 1161.247599] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.247956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1161.247956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.248232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1161.248429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1161.257306] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1163.268138] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1163.268434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.268536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.268750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.268935] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.269142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.269247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.269457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.269568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.269686] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.772126] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.772328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.772391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.772588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.772680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.772899] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.773015] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.773075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.773232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.773314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.773403] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be updated. [ 1163.799208] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.799208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.799208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.799488] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.799583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.807581] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1163.901098] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.901217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.901267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.901505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.901587] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.405214] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.875442] env[62620]: INFO networking_nsxv3.common.synchronization [req-67891c76-0c9b-4295-abc4-75106dd40cfd req-7c325137-4c12-42e6-9196-43d161db240c tempest-ServerActionsV293TestJSON-856706501 tempest-ServerActionsV293TestJSON-856706501-project-member] Enqueued Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_members [ 1164.875442] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_members [ 1164.875442] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20781892-13fd-4ddf-8c97-ac90186655e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.875442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.875442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.875442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.875442] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.875442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.876295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.876625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.876919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.877408] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.907334] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.219257] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-46 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.219257] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-46" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.219403] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-46" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.219755] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-46" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.220074] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.220247] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.220375] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.220621] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.220787] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.221023] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.221164] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.221321] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.221442] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.221577] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.221692] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.221844] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.240357] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.240525] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1165.240671] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.240852] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-46" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.241191] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-438ff9e4-843e-4e29-b42f-fd893752d160 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.241372] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-438ff9e4-843e-4e29-b42f-fd893752d160" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.241501] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-438ff9e4-843e-4e29-b42f-fd893752d160" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.241821] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-438ff9e4-843e-4e29-b42f-fd893752d160" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.241966] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('438ff9e4-843e-4e29-b42f-fd893752d160',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.380301] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.380461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.380528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.380757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.380854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.381070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.381196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.381270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.381450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.381531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.381617] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20781892-13fd-4ddf-8c97-ac90186655e0 already deleted. [ 1165.381698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.410205] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1165.410576] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1165.744630] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.744871] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.745084] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.745487] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.745742] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.745931] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 438ff9e4-843e-4e29-b42f-fd893752d160 not found, creating... [ 1165.746232] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.746409] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.746536] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.746792] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.746944] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.747358] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.747529] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.747656] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.747876] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.748035] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.748187] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 438ff9e4-843e-4e29-b42f-fd893752d160 is going to be created. [ 1165.768282] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.768518] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.768649] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.768927] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.769237] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.769487] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-438ff9e4-843e-4e29-b42f-fd893752d160" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.817260] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1165.817260] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 deletion is rescheduled due to dependency. [ 1165.817260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.185445] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.185628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.185628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.185793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.199613] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1166.200597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.201488] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1166.234770] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.234990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.235048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.235344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.246959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.247704] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1166.247785] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1166.248054] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1166.283256] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.283414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.283488] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.283693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.285457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.285731] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1166.380271] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.380271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.380549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.380549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.381332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.381332] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1166.450917] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.451253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.451253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.451357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.451631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.451928] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1166.452113] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f5026804-13b5-4b49-b1b4-b00084a12c8c', '7ed70962-84b7-45d9-83bd-fb99f1d14ad7', '78b0a132-e0e8-49ae-9afc-c9f27fc1456a', '9631f352-d470-4c89-91c3-5135b61e37bb', '95e0473d-1c6d-4b24-a6d9-f419a29f67f5', 'a3921e17-5705-42fe-988b-f0c37340437f', '3d8167ba-9b98-40d9-ac2f-d2a0923f99c5', 'a7bdbdc9-465d-491e-8f58-3f3aff4b421f', '33d974dd-1e63-4b84-ae24-738b194f0483', '84fabf93-4432-40c4-890b-0bf1580dbb93', '098dac2c-8d52-48ba-bfe3-5e87aaad5495', '6c76585c-33d4-4740-aca6-cc740735e2c9', '94560eb7-1f11-45b3-b778-974dbd9c0094', '9920c684-965b-4092-acfe-6862aa2d1cdb', 'a4bf8496-ff71-4fa9-864f-e73e2d343c8a', '6c995751-5151-4812-a1e5-510ea09222e0', '20f5a061-dbd0-44d6-953b-0f455ddef899', '1536c72e-7b4e-46f0-a419-8f3b5002e371', 'fddb815e-1994-464a-8450-9db44691d6ac', '5b8397bc-7c95-4fde-85f0-d0f8be61ee49', '155d9c67-3c1f-4b2c-9601-a53c9b438946', '787f7736-c1a9-4a6d-8e59-532c4a82467e', '9338b344-e20e-4f2c-889d-3246eaae326d', '4a6af52c-b1fd-4489-b26c-557260173089', 'e8ef3419-3f65-45f7-8a65-b4c2453d9fb8', '255ec5a6-942e-49be-b759-c091160337f6', '7027a4f2-13d4-467a-96da-8c378fa8ac69', 'd202a637-704d-4648-b15e-1c9cbe21b05b', '555614d8-7992-4190-9420-95843d76b986', '0a74e416-c2f5-41f6-a7d3-a2cd9c682858', '17653238-10f5-4057-bb3a-0d1116cfe7f0', '7c469d6d-346a-40a2-adb5-8c50f7758224', 'b140e556-13f7-4e22-a7d6-53ddc3943100', 'b27f6472-ff8f-4e87-ba84-3f06d7d9c925', 'd79c3337-b12e-40d4-993c-c4d5954de7b0', '84776719-6313-41bf-88fe-129baf34c6ed', 'b84c6a20-87b1-462b-accd-d32f1296df07', '16d45250-e90b-4ed6-befa-bdaacfced30b', 'b2bbf04f-3b75-4f98-a58c-b7dfe66747dd', 'c72dcb51-694a-46ed-b921-12a44f522163'} {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1166.452113] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1166.475298] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.475481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.475551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.475793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.475882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.475982] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1166.476067] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1166.476137] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1166.534249] env[62620]: INFO networking_nsxv3.common.synchronization [req-67891c76-0c9b-4295-abc4-75106dd40cfd req-cbe0cd79-2dec-4bcb-b1e2-e4a5f195d297 service nova] Enqueued Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_rules [ 1166.534249] env[62620]: INFO networking_nsxv3.common.synchronization [req-67891c76-0c9b-4295-abc4-75106dd40cfd req-cbe0cd79-2dec-4bcb-b1e2-e4a5f195d297 service nova] Enqueued Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_members [ 1166.534249] env[62620]: INFO networking_nsxv3.common.synchronization [req-67891c76-0c9b-4295-abc4-75106dd40cfd req-cbe0cd79-2dec-4bcb-b1e2-e4a5f195d297 service nova] Enqueued Resource ID: 438ff9e4-843e-4e29-b42f-fd893752d160 with Priority: HIGHEST for action port [ 1166.534249] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_rules [ 1166.534249] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_members [ 1166.534249] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 438ff9e4-843e-4e29-b42f-fd893752d160 with Priority: HIGHEST for action port [ 1166.534249] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20781892-13fd-4ddf-8c97-ac90186655e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.534249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.534249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.534781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.534965] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.536180] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20781892-13fd-4ddf-8c97-ac90186655e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.536413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.536562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.536831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.537092] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.537337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.537497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.537737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.537916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.538100] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.538952] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-438ff9e4-843e-4e29-b42f-fd893752d160 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.539285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-438ff9e4-843e-4e29-b42f-fd893752d160" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.539450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-438ff9e4-843e-4e29-b42f-fd893752d160" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.539683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-438ff9e4-843e-4e29-b42f-fd893752d160" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.539887] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('438ff9e4-843e-4e29-b42f-fd893752d160',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.544724] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.545642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.545642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.545642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.546447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.546695] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1166.546761] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1166.547293] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1166.547293] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1166.547293] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1166.547293] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGH for action security_group_rules [ 1166.547293] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGH for action security_group_rules [ 1166.547719] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGH for action security_group_rules [ 1166.547719] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGH for action security_group_rules [ 1166.547719] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGH for action security_group_rules [ 1166.547719] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGH for action security_group_rules [ 1166.547719] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGH for action security_group_rules [ 1166.547719] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGH for action security_group_rules [ 1166.547970] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGH for action security_group_rules [ 1166.547970] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGH for action security_group_rules [ 1166.547970] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGH for action security_group_rules [ 1166.548359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGH for action security_group_rules [ 1166.548359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGH for action security_group_rules [ 1166.548359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGH for action security_group_rules [ 1166.548359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGH for action security_group_rules [ 1166.548493] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGH for action security_group_rules [ 1166.548493] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGH for action security_group_rules [ 1166.548586] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGH for action security_group_rules [ 1166.548674] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGH for action security_group_rules [ 1166.548742] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGH for action security_group_rules [ 1166.548842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.050706] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.051775] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20781892-13fd-4ddf-8c97-ac90186655e0 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.051891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.052178] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 438ff9e4-843e-4e29-b42f-fd893752d160 with status ACTIVE [ 1167.052291] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.053112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.053245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.053925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.053925] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.053925] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.054187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.054187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.054372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.054372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.054556] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.054556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.054778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.054778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.054882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.054882] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 438ff9e4-843e-4e29-b42f-fd893752d160 is going to be updated. [ 1167.077010] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.077263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.077263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.077453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.077596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.077817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-438ff9e4-843e-4e29-b42f-fd893752d160" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.561193] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.064067] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.064275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1168.064275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.064914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.064914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.064914] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20781892-13fd-4ddf-8c97-ac90186655e0 is going to be created. [ 1168.087903] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.088427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1168.088656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.089484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.089484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.099024] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20781892-13fd-4ddf-8c97-ac90186655e0 in Status: UNINITIALIZED for 2s [ 1169.175769] env[62620]: INFO networking_nsxv3.common.synchronization [req-e31d8386-5288-4d21-960c-f2c6c7f95ff4 req-2de59763-80fa-4199-8936-62247e89aa34 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_members [ 1169.175769] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGHEST for action security_group_members [ 1169.175769] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGH for action security_group_rules [ 1169.176374] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGH for action security_group_rules [ 1169.176374] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 with Priority: HIGH for action security_group_rules [ 1169.176374] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a with Priority: HIGH for action security_group_rules [ 1169.176374] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 with Priority: HIGH for action security_group_rules [ 1169.176374] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fddb815e-1994-464a-8450-9db44691d6ac with Priority: HIGH for action security_group_rules [ 1169.176662] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGH for action security_group_rules [ 1169.176662] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGH for action security_group_rules [ 1169.176662] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9920c684-965b-4092-acfe-6862aa2d1cdb with Priority: HIGH for action security_group_rules [ 1169.177323] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c995751-5151-4812-a1e5-510ea09222e0 with Priority: HIGH for action security_group_rules [ 1169.177323] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 with Priority: HIGH for action security_group_rules [ 1169.177323] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGH for action security_group_rules [ 1169.177323] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGH for action security_group_rules [ 1169.177323] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 with Priority: HIGH for action security_group_rules [ 1169.177570] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d974dd-1e63-4b84-ae24-738b194f0483 with Priority: HIGH for action security_group_rules [ 1169.177570] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGH for action security_group_rules [ 1169.177570] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGH for action security_group_rules [ 1169.177659] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 with Priority: HIGH for action security_group_rules [ 1169.177799] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 with Priority: HIGH for action security_group_rules [ 1169.178183] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9631f352-d470-4c89-91c3-5135b61e37bb with Priority: HIGH for action security_group_rules [ 1169.178510] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-fddb815e-1994-464a-8450-9db44691d6ac taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.178677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.178749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.179067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.179287] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.179422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.179629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.180197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.180197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.180197] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.181307] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.181480] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.181480] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.181791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.181923] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.183241] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.183486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.183486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.183736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.183848] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.184832] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.185064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.185219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.185919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.185919] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8167ba-9b98-40d9-ac2f-d2a0923f99c5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.186489] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.187471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.187471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.187471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.187471] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4bf8496-ff71-4fa9-864f-e73e2d343c8a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.190098] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.190098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.190098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.190098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.190098] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b8397bc-7c95-4fde-85f0-d0f8be61ee49',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.190098] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fddb815e-1994-464a-8450-9db44691d6ac taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.194064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.194064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.194064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.194064] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fddb815e-1994-464a-8450-9db44691d6ac',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.194064] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.194064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.194064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.194064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.194064] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.194064] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.194064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.194064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.194064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.194064] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.195518] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9920c684-965b-4092-acfe-6862aa2d1cdb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.195518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.195518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.195518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.196870] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9920c684-965b-4092-acfe-6862aa2d1cdb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.197265] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c995751-5151-4812-a1e5-510ea09222e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.197459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.197534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.197774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.197891] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c995751-5151-4812-a1e5-510ea09222e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.198920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94560eb7-1f11-45b3-b778-974dbd9c0094 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.199231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.199336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.199661] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.199771] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94560eb7-1f11-45b3-b778-974dbd9c0094',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.201151] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.201151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.201151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.201626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.203075] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.203861] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.204147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.204187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.204406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.204519] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.205639] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84fabf93-4432-40c4-890b-0bf1580dbb93 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.205775] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.205853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.206382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.206531] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84fabf93-4432-40c4-890b-0bf1580dbb93',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.208063] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33d974dd-1e63-4b84-ae24-738b194f0483 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.212818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.212818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.212818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.212818] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33d974dd-1e63-4b84-ae24-738b194f0483',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.213814] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.213974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.214210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.214504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.214633] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.215974] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.216102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.216190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.216499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.216697] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.219396] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.219396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.219396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.219396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.219396] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95e0473d-1c6d-4b24-a6d9-f419a29f67f5',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.219992] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.219992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.219992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.220405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.220516] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ed70962-84b7-45d9-83bd-fb99f1d14ad7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.222553] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9631f352-d470-4c89-91c3-5135b61e37bb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.222553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.222553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.222553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.222553] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9631f352-d470-4c89-91c3-5135b61e37bb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.227374] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.227580] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.227676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.227944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.232263] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.232263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.232263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.232263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.232263] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.232263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.232263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.232263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.232263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.232263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.232263] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.258950] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.259207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.260235] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.260510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.263258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.263390] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.263504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.263578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.263818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.263912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.264038] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fddb815e-1994-464a-8450-9db44691d6ac is going to be updated. [ 1169.265404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.265564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.288885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.289074] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4bf8496-ff71-4fa9-864f-e73e2d343c8a is going to be deleted. [ 1169.290302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.291060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.295192] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.295375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.295375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.295619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.295835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.306267] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fddb815e-1994-464a-8450-9db44691d6ac in Status: IN_PROGRESS for 2s [ 1169.313759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.313977] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8167ba-9b98-40d9-ac2f-d2a0923f99c5 is going to be deleted. [ 1169.355024] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.355411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.355485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.355750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.355850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.356024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4bf8496-ff71-4fa9-864f-e73e2d343c8a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.361135] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.361424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.361671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.361982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.362124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.362320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8167ba-9b98-40d9-ac2f-d2a0923f99c5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.719514] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.719514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.719514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.720038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.720038] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.720180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.720180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.720322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.720411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.720502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.720586] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.724313] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.724313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.724684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.724766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.724972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.725104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.725241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.725481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.725576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.725666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.725747] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.736340] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.736340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.737261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.737261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.737261] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.737261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.737261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.738279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.738279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.738279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.738279] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.739656] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.739845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.739845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.740326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.740326] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.740326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.740326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.740553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.740553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.740671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.740737] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.741896] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.741896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.741896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.741896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.742823] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.742823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.742823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.742823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.742823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.742823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.742823] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.755556] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.755710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.755780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.755996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.756182] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.756301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.756372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.756516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.756591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.756673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.756817] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.756910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.756973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.757138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.757306] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.757400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.757472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.757589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.757660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.757742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.757826] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.782080] env[62620]: INFO networking_nsxv3.common.synchronization [req-bc716414-d176-4607-9d1f-27d1d1ade42c req-b533ab8e-88ec-4e48-a83b-b0b7f61c1fde tempest-ServerRescueNegativeTestJSON-1339547319 tempest-ServerRescueNegativeTestJSON-1339547319-project-member] Enqueued Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 1169.799882] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 1169.801813] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.801997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.802148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.802832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.807364] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.807497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.810341] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.810540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.811858] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.812064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.815728] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.819020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.819020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.819020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.819020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.819020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.819020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.819020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.819020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.819020] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.825751] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.825959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.827311] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.827504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.828705] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.829184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.830036] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.830196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.831457] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.831604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.834067] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.834216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.839535] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.839644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.846728] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1169.847478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.847685] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33d974dd-1e63-4b84-ae24-738b194f0483 is going to be deleted. [ 1169.849628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.849873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.852446] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.852587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.868082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.868373] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3921e17-5705-42fe-988b-f0c37340437f is going to be deleted. [ 1169.869727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.870053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.889315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.889717] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94560eb7-1f11-45b3-b778-974dbd9c0094 is going to be deleted. [ 1169.891048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.891048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.908927] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.909153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.912078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.912078] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9631f352-d470-4c89-91c3-5135b61e37bb is going to be deleted. [ 1169.913055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.913188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.913233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.913416] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fddb815e-1994-464a-8450-9db44691d6ac is going to be deleted. [ 1169.914240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.914442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.917349] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.917484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.935465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.935621] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b8397bc-7c95-4fde-85f0-d0f8be61ee49 is going to be deleted. [ 1169.936535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.936752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.980881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.981784] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9920c684-965b-4092-acfe-6862aa2d1cdb is going to be deleted. [ 1169.982223] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.982455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.984141] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.984277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.017386] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.017386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.022017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.022539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.035123] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.035323] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95e0473d-1c6d-4b24-a6d9-f419a29f67f5 is going to be deleted. [ 1170.036356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.036964] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.039751] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.039899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.103442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.103442] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ed70962-84b7-45d9-83bd-fb99f1d14ad7 is going to be deleted. [ 1170.103442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.103442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.104767] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.104894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.122830] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20781892-13fd-4ddf-8c97-ac90186655e0 in Status: SUCCESS [ 1170.123505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.126025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.126025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.126025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.126025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.126025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.126025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.126025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.126025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.126025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.180893] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.180893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.204100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.205033] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be deleted. [ 1170.205341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.205592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.231136] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.231352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.231427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.231647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.231824] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.231932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.231992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.232138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.232223] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.232312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.232455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.232546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.232626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.232823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.232962] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.233067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.233145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.233274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.233395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.233490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.233582] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.234578] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.252677] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.253542] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.254218] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.273714] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5026804-13b5-4b49-b1b4-b00084a12c8c: rpc.has_security_group_logging(os_id): False [ 1170.277912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.278192] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84fabf93-4432-40c4-890b-0bf1580dbb93 is going to be deleted. [ 1170.279647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.279965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.285153] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.285442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.312768] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.312966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.337871] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.343283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.343283] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c995751-5151-4812-a1e5-510ea09222e0 is going to be deleted. [ 1170.343283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.343283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.343283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.343283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33d974dd-1e63-4b84-ae24-738b194f0483" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.343283] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.343856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.343856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.343856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.343856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.343856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.344394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.344613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.344732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.344873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.345810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.346054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.346170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.346414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9631f352-d470-4c89-91c3-5135b61e37bb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.346588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.346752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.346834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.346948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94560eb7-1f11-45b3-b778-974dbd9c0094" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.347554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.347746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.347858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.348016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.348554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.348750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.348854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.349309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b8397bc-7c95-4fde-85f0-d0f8be61ee49" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.349841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.350056] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.350185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.350527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9920c684-965b-4092-acfe-6862aa2d1cdb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.351532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.351768] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.351856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.352019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95e0473d-1c6d-4b24-a6d9-f419a29f67f5" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.352322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.352426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.352487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.352644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ed70962-84b7-45d9-83bd-fb99f1d14ad7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.353175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.353370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.366667] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.367383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.404940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.404940] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.404940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.404940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.404940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.404940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.404940] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.404940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.404940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.404940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.404940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.404940] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.405566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.405566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.405566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.405566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.405566] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1170.407310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.407525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.407617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.407740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84fabf93-4432-40c4-890b-0bf1580dbb93" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.556470] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.556470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.556470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.556470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.556470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.556470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c995751-5151-4812-a1e5-510ea09222e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.566712] env[62620]: INFO networking_nsxv3.common.synchronization [req-01508733-a48d-4853-b07d-ddc7d1054d51 req-4ec4b32a-7aff-4306-91c2-b17a852e5498 tempest-DeleteServersTestJSON-1791757005 tempest-DeleteServersTestJSON-1791757005-project-member] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1170.566712] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGHEST for action security_group_members [ 1170.566712] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.566712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.566712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.566712] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.567644] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.567906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.568084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.568678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.568916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.569189] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.607386] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1170.607579] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.607727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.607727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.607949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.608175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.628808] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.644284] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1170.736736] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c76585c-33d4-4740-aca6-cc740735e2c9: rpc.has_security_group_logging(os_id): False [ 1170.738328] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7bdbdc9-465d-491e-8f58-3f3aff4b421f: rpc.has_security_group_logging(os_id): False [ 1170.758409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.758409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.758409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.758409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.758409] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 098dac2c-8d52-48ba-bfe3-5e87aaad5495: rpc.has_security_group_logging(os_id): False [ 1170.759491] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1536c72e-7b4e-46f0-a419-8f3b5002e371: rpc.has_security_group_logging(os_id): False [ 1170.760597] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78b0a132-e0e8-49ae-9afc-c9f27fc1456a: rpc.has_security_group_logging(os_id): False [ 1170.761716] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.761841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.778132] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.778329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.780702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.780702] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.780957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.780957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.781239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.781358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.781445] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f is going to be updated. [ 1170.783540] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.783667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.783706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.783921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.785760] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.785916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.802251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.802755] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.802871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.802945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.803233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.803334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.803431] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1170.804752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.804973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.826370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.826734] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.826893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.827053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.827325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.827447] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.827536] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 is going to be updated. [ 1170.828843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.829042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.845184] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.847179] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.847583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.850377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.850775] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.850985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.851104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.851376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.851500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.851634] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a is going to be updated. [ 1170.853452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.853653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.872703] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.872867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.873784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.874022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.874132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.874223] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.874481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.874586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.874765] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.874865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.874931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.875098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.875175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.876035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.876035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.876035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.876035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.876035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.876035] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be updated. [ 1170.877479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.878076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.878331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.879389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.879574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.879710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.891889] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.892100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.892100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.892547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.892802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.895308] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1170.896070] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: IN_PROGRESS for 2s [ 1170.906390] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 in Status: IN_PROGRESS for 2s [ 1170.928627] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.928817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.928921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.929167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.929316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.957278] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a in Status: IN_PROGRESS for 2s [ 1170.965100] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.965254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.965320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.965624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.965736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.986632] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: IN_PROGRESS for 2s [ 1171.074053] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.074263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1171.074327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.074617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1171.117099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.117099] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.117099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1171.117099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.117099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1171.117099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.117099] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be updated. [ 1171.132268] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20781892-13fd-4ddf-8c97-ac90186655e0: rpc.has_security_group_logging(os_id): False [ 1171.153096] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.153096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1171.153096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.153986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1171.153986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.153986] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.153986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1171.153986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.153986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1171.154328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.154328] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20781892-13fd-4ddf-8c97-ac90186655e0 is going to be created. [ 1171.158720] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.158888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1171.159012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.159364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1171.160289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.168742] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: IN_PROGRESS for 2s [ 1171.228446] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.228866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1171.228866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.229125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1171.229217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.242625] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20781892-13fd-4ddf-8c97-ac90186655e0 in Status: IN_PROGRESS for 2s [ 1171.315733] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fddb815e-1994-464a-8450-9db44691d6ac in Status: SUCCESS [ 1171.315970] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fddb815e-1994-464a-8450-9db44691d6ac deletion is rescheduled due to dependency. [ 1171.316138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fddb815e-1994-464a-8450-9db44691d6ac" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.348876] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.349054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1171.349128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.349406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1171.349595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.349824] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 is going to be updated. [ 1171.389701] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.389862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1171.389940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.390155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1171.390306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.401333] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: IN_PROGRESS for 2s [ 1172.664375] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1172.664767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.913528] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1172.913800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.914638] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: SUCCESS [ 1172.914830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.917636] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 in Status: SUCCESS [ 1172.917826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.970800] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a in Status: SUCCESS [ 1172.971051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.997666] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1172.998112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1173.177383] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 in Status: SUCCESS [ 1173.177667] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 deletion is rescheduled due to dependency. [ 1173.177849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1173.254860] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20781892-13fd-4ddf-8c97-ac90186655e0 in Status: SUCCESS [ 1173.255129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1173.411163] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: SUCCESS [ 1173.413096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.271080] env[62620]: INFO networking_nsxv3.common.synchronization [None req-362ebdbd-eb7f-4672-ba2d-e33968034174 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_rules [ 1174.271669] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_rules [ 1174.272021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.272196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.272271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.272572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.272701] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.349918] env[62620]: INFO networking_nsxv3.common.synchronization [None req-12c61d61-f9a0-4661-9776-e5510e581ee6 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_rules [ 1174.350789] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_rules [ 1174.351122] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.351226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.794705] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.794990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.794990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.795185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.795275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.795388] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 already deleted. [ 1174.795477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.795642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.795799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.795885] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.318973] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.319286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.319286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.319510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.319694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1175.319751] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 already deleted. [ 1175.319832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.649338] env[62620]: INFO networking_nsxv3.common.synchronization [req-17fe70c8-1277-40a6-82ca-ca355311b358 req-18c2b857-63db-4d24-8412-68663bf0990a tempest-ServerRescueNegativeTestJSON-1339547319 tempest-ServerRescueNegativeTestJSON-1339547319-project-member] Enqueued Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 1177.649338] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGHEST for action security_group_members [ 1177.649338] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.649338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.649338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.649338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.649338] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.649338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.649338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.649338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.649338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.651166] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.151537] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.151704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.151812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.151994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.171816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.172087] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.172259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.172377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.172482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.172560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.172644] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 is going to be updated. [ 1178.197574] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.197574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.197574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.197574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.197906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.205474] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: IN_PROGRESS for 2s [ 1180.215527] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 in Status: SUCCESS [ 1180.215861] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 deletion is rescheduled due to dependency. [ 1180.215861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.267165] env[62620]: INFO networking_nsxv3.common.synchronization [None req-11434f07-7086-4a59-8fa6-0c4960864655 tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: d79a27d2-b9c2-44c0-ba88-401ff8d096d6 with Priority: HIGHEST for action security_group_rules [ 1181.267688] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a27d2-b9c2-44c0-ba88-401ff8d096d6 with Priority: HIGHEST for action security_group_rules [ 1181.267688] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.267815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.267852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.268406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.268496] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d79a27d2-b9c2-44c0-ba88-401ff8d096d6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.420426] env[62620]: INFO networking_nsxv3.common.synchronization [None req-e99ba06b-80f4-4d74-9e20-7113a8b54dab tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: d79a27d2-b9c2-44c0-ba88-401ff8d096d6 with Priority: HIGHEST for action security_group_rules [ 1181.420899] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a27d2-b9c2-44c0-ba88-401ff8d096d6 with Priority: HIGHEST for action security_group_rules [ 1181.421233] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.421381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.792024] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.792024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.792024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.792024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.792024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.792024] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d79a27d2-b9c2-44c0-ba88-401ff8d096d6 already deleted. [ 1181.792024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.792024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.792024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.792024] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d79a27d2-b9c2-44c0-ba88-401ff8d096d6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.323135] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.323397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.323397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.323510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.323601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.323698] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d79a27d2-b9c2-44c0-ba88-401ff8d096d6 already deleted. [ 1182.323782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d79a27d2-b9c2-44c0-ba88-401ff8d096d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.788632] env[62620]: INFO networking_nsxv3.common.synchronization [req-5a8b7cce-93b5-4ee9-a0ba-5d7d1c2052d0 req-d3967709-e212-45cd-81fe-d9c8e4dbdf39 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1182.789432] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1182.789652] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.789713] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.789752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.790106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.790295] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.790441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.790497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.790681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.790805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.790893] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.203039] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.203271] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.203426] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.203715] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.203985] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.204640] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.204865] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.205193] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.205440] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.205719] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1183.205899] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.206070] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.206227] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.206410] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1183.206654] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.206765] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.226618] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.226921] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1183.227137] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.227420] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.227826] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-58815871-fdac-4406-a61e-4d7fca125122 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.228088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-58815871-fdac-4406-a61e-4d7fca125122" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.228265] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-58815871-fdac-4406-a61e-4d7fca125122" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.228721] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-58815871-fdac-4406-a61e-4d7fca125122" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.228959] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58815871-fdac-4406-a61e-4d7fca125122',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.293062] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.293283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.293376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.293618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.293743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.294035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.294194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.294194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.294337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.294412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.294609] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 already deleted. [ 1183.294609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.731719] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.732065] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.732117] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.732404] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.732556] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.732717] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 58815871-fdac-4406-a61e-4d7fca125122 not found, creating... [ 1183.732995] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.733171] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.733293] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.733549] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.733690] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.733985] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.736813] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.736951] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.737260] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.737459] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.737961] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 58815871-fdac-4406-a61e-4d7fca125122 is going to be created. [ 1183.757129] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.757561] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.757757] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.758098] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.758400] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.758670] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-58815871-fdac-4406-a61e-4d7fca125122" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1184.442328] env[62620]: INFO networking_nsxv3.common.synchronization [None req-69effa62-1945-406b-b11f-69e4f04bb0b3 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_rules [ 1184.442328] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_rules [ 1184.442328] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84080db-2e0a-4513-addc-aca7401b2740 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.442328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1184.442328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.442328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1184.442611] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.524013] env[62620]: INFO networking_nsxv3.common.synchronization [None req-818f91e9-96cb-4397-96e4-b81180a12c76 None None] Enqueued Resource ID: a6a4b0a6-f159-4e2a-ae04-3e77303227a4 with Priority: HIGHEST for action port [ 1184.524013] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a4b0a6-f159-4e2a-ae04-3e77303227a4 with Priority: HIGHEST for action port [ 1184.524697] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6a4b0a6-f159-4e2a-ae04-3e77303227a4 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.524828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6a4b0a6-f159-4e2a-ae04-3e77303227a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1184.526554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6a4b0a6-f159-4e2a-ae04-3e77303227a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.532906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6a4b0a6-f159-4e2a-ae04-3e77303227a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1184.532906] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6a4b0a6-f159-4e2a-ae04-3e77303227a4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.762308] env[62620]: INFO networking_nsxv3.common.synchronization [None req-59f7b3af-2948-4748-81ac-62813ab1f078 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_rules [ 1184.762715] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_rules [ 1184.763147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84080db-2e0a-4513-addc-aca7401b2740 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.763433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1184.966566] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.966566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1184.966566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.967018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1184.967018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1184.967018] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84080db-2e0a-4513-addc-aca7401b2740 already deleted. [ 1184.968736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1184.968736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.968736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1184.968736] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.033381] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6a4b0a6-f159-4e2a-ae04-3e77303227a4 [ 1185.033739] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.034089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.034693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.035018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.035155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.035531] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6a4b0a6-f159-4e2a-ae04-3e77303227a4 already deleted. [ 1185.035946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6a4b0a6-f159-4e2a-ae04-3e77303227a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.412481] env[62620]: INFO networking_nsxv3.common.synchronization [req-5a8b7cce-93b5-4ee9-a0ba-5d7d1c2052d0 req-f03060d4-fe22-4926-a911-944a4950e7e3 service nova] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_rules [ 1185.412852] env[62620]: INFO networking_nsxv3.common.synchronization [req-5a8b7cce-93b5-4ee9-a0ba-5d7d1c2052d0 req-f03060d4-fe22-4926-a911-944a4950e7e3 service nova] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1185.413807] env[62620]: INFO networking_nsxv3.common.synchronization [req-5a8b7cce-93b5-4ee9-a0ba-5d7d1c2052d0 req-f03060d4-fe22-4926-a911-944a4950e7e3 service nova] Enqueued Resource ID: 58815871-fdac-4406-a61e-4d7fca125122 with Priority: HIGHEST for action port [ 1185.414603] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_rules [ 1185.414848] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1185.415150] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58815871-fdac-4406-a61e-4d7fca125122 with Priority: HIGHEST for action port [ 1185.415818] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.416185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.417236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.417236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.417236] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.418568] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.418941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.419384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.419693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.420266] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.420266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.420803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.422024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.422024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.422024] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.422354] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-58815871-fdac-4406-a61e-4d7fca125122 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.424017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58815871-fdac-4406-a61e-4d7fca125122" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.424017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58815871-fdac-4406-a61e-4d7fca125122" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.424017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58815871-fdac-4406-a61e-4d7fca125122" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.424017] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58815871-fdac-4406-a61e-4d7fca125122',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.490157] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.490157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.490157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.490157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.490157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.490157] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84080db-2e0a-4513-addc-aca7401b2740 already deleted. [ 1185.490157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.854782] env[62620]: INFO networking_nsxv3.common.synchronization [None req-1bf89663-5240-439d-9c71-1343134854e9 tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_rules [ 1185.856558] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_rules [ 1185.856558] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.856558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.856558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.856558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.856558] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.925093] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.925332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.925491] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.927209] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58815871-fdac-4406-a61e-4d7fca125122 with status ACTIVE [ 1185.927425] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.927521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.927614] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.927891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.927986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.928183] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.928284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.928394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.928684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.928684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.928811] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.928923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.928986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.929161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.929237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.929334] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58815871-fdac-4406-a61e-4d7fca125122 is going to be updated. [ 1185.949110] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.949321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.949405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.949643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.949833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.950043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58815871-fdac-4406-a61e-4d7fca125122" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.003312] env[62620]: INFO networking_nsxv3.common.synchronization [None req-5f857f4b-52f4-4a65-9d2d-188a30cd37e8 tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_rules [ 1186.003958] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_rules [ 1186.004357] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.004521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.376613] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.377453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.377605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.377883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.380040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.380040] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d already deleted. [ 1186.380040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.380040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.380040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.380040] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.431024] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.558532] env[62620]: INFO networking_nsxv3.common.synchronization [req-96daf845-dd40-4456-8ba3-78dae5c6a720 req-6fc62d19-785a-4263-b8f9-5c83c82c7e83 tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1186.559713] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1186.560023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.560202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.561429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.561429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.561790] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.562009] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.562070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.562322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.562891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.563755] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.887166] env[62620]: INFO networking_nsxv3.common.synchronization [None req-a8fdb1fd-ce15-4b49-9e19-56dda92df0d3 None None] Enqueued Resource ID: 7b5cd53e-2e77-4649-a169-0de871ff5ade with Priority: HIGHEST for action port [ 1186.891637] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b5cd53e-2e77-4649-a169-0de871ff5ade with Priority: HIGHEST for action port [ 1186.893028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b5cd53e-2e77-4649-a169-0de871ff5ade taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.893028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b5cd53e-2e77-4649-a169-0de871ff5ade" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.893028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b5cd53e-2e77-4649-a169-0de871ff5ade" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.893028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b5cd53e-2e77-4649-a169-0de871ff5ade" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.893343] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b5cd53e-2e77-4649-a169-0de871ff5ade',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.904417] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.904571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.904653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.904860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.904951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.905055] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d already deleted. [ 1186.905140] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.934024] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.934244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.934294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.934529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.934641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.934753] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 is going to be created. [ 1186.956100] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.956272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.956378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.956772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.956987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.966700] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: UNINITIALIZED for 2s [ 1187.065591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.065783] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.065836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.066089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.066185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.066423] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.066526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.066588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.066746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.067217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.067217] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1187.095276] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.095443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.095500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.095697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.095918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.106742] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1187.395420] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b5cd53e-2e77-4649-a169-0de871ff5ade [ 1187.396089] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.396089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.396089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.396270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.396270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.396340] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b5cd53e-2e77-4649-a169-0de871ff5ade already deleted. [ 1187.396376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b5cd53e-2e77-4649-a169-0de871ff5ade" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.921229] env[62620]: INFO networking_nsxv3.common.synchronization [req-a9fc708b-207f-46ff-a70c-7195be176eb5 req-27eef43c-d13a-44b0-9da2-f75e359a54bf tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1187.921742] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1187.922059] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.922158] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.301131] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.301355] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.301505] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.301830] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.302128] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.302322] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.302460] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.302894] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.303093] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.303323] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.303461] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.303597] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.303727] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.303847] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.303972] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.304156] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.321256] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.321448] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1188.321602] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.321796] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.322155] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.322348] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.322476] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.322841] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.322987] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d885a4e0-fbdd-41cf-9e49-1e16cd392ecf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.825872] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.826136] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.826287] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.826569] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.826809] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.827081] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port d885a4e0-fbdd-41cf-9e49-1e16cd392ecf not found, creating... [ 1188.827519] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.827716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.827847] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.828102] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.828256] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.828579] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.828815] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.828963] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.829242] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.829414] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.829615] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: d885a4e0-fbdd-41cf-9e49-1e16cd392ecf is going to be created. [ 1188.859493] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.859665] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.859779] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.860041] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.860272] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.860497] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.975942] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: SUCCESS [ 1188.976245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.976414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.977029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.977029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.977029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.977029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.977277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.977277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.977277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.977437] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.116707] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1189.116889] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c deletion is rescheduled due to dependency. [ 1189.117019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.117172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.117423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.117604] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.117729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.117796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.117952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.118048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.118143] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.479549] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.559746] env[62620]: INFO networking_nsxv3.common.synchronization [req-a9fc708b-207f-46ff-a70c-7195be176eb5 req-e877ef21-602e-4859-99d7-53906af288d6 service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1189.559927] env[62620]: INFO networking_nsxv3.common.synchronization [req-a9fc708b-207f-46ff-a70c-7195be176eb5 req-e877ef21-602e-4859-99d7-53906af288d6 service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1189.560084] env[62620]: INFO networking_nsxv3.common.synchronization [req-a9fc708b-207f-46ff-a70c-7195be176eb5 req-e877ef21-602e-4859-99d7-53906af288d6 service nova] Enqueued Resource ID: d885a4e0-fbdd-41cf-9e49-1e16cd392ecf with Priority: HIGHEST for action port [ 1189.560318] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1189.560500] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1189.560567] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d885a4e0-fbdd-41cf-9e49-1e16cd392ecf with Priority: HIGHEST for action port [ 1189.561108] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.561320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.561320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.561545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.561586] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.562386] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.562475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.563593] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.563593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.563593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.563593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.563593] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d885a4e0-fbdd-41cf-9e49-1e16cd392ecf',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.620034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.620187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.620297] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.620524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.620635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.620838] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.620949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.621013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.621194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.621242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.621319] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1189.656356] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.656496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.656540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.656693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.656826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.665828] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1189.982088] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f23bc15-3356-4a60-a94f-750f1fd18026: rpc.has_security_group_logging(os_id): False [ 1190.002203] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.002390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.002442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.002662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.002756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.003079] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.003200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.003583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.003857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.003972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.004116] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 is going to be created. [ 1190.061410] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.061665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.061744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.062009] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.062217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.065356] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.065550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.066860] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d885a4e0-fbdd-41cf-9e49-1e16cd392ecf with status ACTIVE [ 1190.067093] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.067218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.067308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.067613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.067718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.067956] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.068091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.068187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.068438] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.068536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.068780] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.068900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.068998] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.069193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.069296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.069412] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d885a4e0-fbdd-41cf-9e49-1e16cd392ecf is going to be updated. [ 1190.097775] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: IN_PROGRESS for 2s [ 1190.113888] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.114187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.114187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.114462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.114462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.114630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d885a4e0-fbdd-41cf-9e49-1e16cd392ecf" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1191.675924] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1191.676313] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c deletion is rescheduled due to dependency. [ 1191.676313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1191.676424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.676585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1191.676774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.676892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1191.676952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.677118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1191.677199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1191.677294] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.110150] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: SUCCESS [ 1192.110150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.179230] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.363082] env[62620]: INFO networking_nsxv3.common.synchronization [req-ab161b8d-12ec-4c22-a16b-11c16ec186ad req-331105ec-de73-446c-a7f5-296bcf4462cf tempest-ServerMetadataNegativeTestJSON-1118921947 tempest-ServerMetadataNegativeTestJSON-1118921947-project-member] Enqueued Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGHEST for action security_group_members [ 1192.363082] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGHEST for action security_group_members [ 1192.363082] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b704bfdd-e753-458e-8533-d3a8d632a866 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.363082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.363082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.363082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.363082] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.363082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.363082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.363082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.363082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.363082] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b704bfdd-e753-458e-8533-d3a8d632a866',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.681948] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.697485] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-773 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.697736] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-773" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.697855] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-773" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.698225] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-773" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.698920] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.698920] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.698920] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.699102] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.699140] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.699345] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.699469] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.699592] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.699705] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.699840] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.699964] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.700119] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.717645] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.717832] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1192.717987] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.718190] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-773" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.718505] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.718706] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.718803] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.719737] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.719737] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1d904fd-a7a5-45af-a796-47dcf5bf2e4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.865266] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.865511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.865598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.865808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.865900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.866176] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.866292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.866292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.866430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.866507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.866592] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b704bfdd-e753-458e-8533-d3a8d632a866 already deleted. [ 1192.866673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.185279] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.185537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.185636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.185781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.185869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.185973] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1193.215126] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.215372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.215544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.215826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.215999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.221954] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.222206] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.222826] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.222826] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.222826] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.223016] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port f1d904fd-a7a5-45af-a796-47dcf5bf2e4e not found, creating... [ 1193.223255] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.223415] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.223540] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.223770] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.223916] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.224221] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.224538] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.224538] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.224722] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.224877] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.225046] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: f1d904fd-a7a5-45af-a796-47dcf5bf2e4e is going to be created. [ 1193.226750] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1193.259444] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.259582] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.260029] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.260123] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.260387] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.260782] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.981318] env[62620]: INFO networking_nsxv3.common.synchronization [req-ab161b8d-12ec-4c22-a16b-11c16ec186ad req-1d8c50cf-364d-4e8c-a707-0ff4f00fc9ff service nova] Enqueued Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGHEST for action security_group_rules [ 1193.981318] env[62620]: INFO networking_nsxv3.common.synchronization [req-ab161b8d-12ec-4c22-a16b-11c16ec186ad req-1d8c50cf-364d-4e8c-a707-0ff4f00fc9ff service nova] Enqueued Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGHEST for action security_group_members [ 1193.981318] env[62620]: INFO networking_nsxv3.common.synchronization [req-ab161b8d-12ec-4c22-a16b-11c16ec186ad req-1d8c50cf-364d-4e8c-a707-0ff4f00fc9ff service nova] Enqueued Resource ID: f1d904fd-a7a5-45af-a796-47dcf5bf2e4e with Priority: HIGHEST for action port [ 1193.981318] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGHEST for action security_group_rules [ 1193.981604] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGHEST for action security_group_members [ 1193.981604] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d904fd-a7a5-45af-a796-47dcf5bf2e4e with Priority: HIGHEST for action port [ 1193.982034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b704bfdd-e753-458e-8533-d3a8d632a866 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.982157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.982290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.984156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.984850] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b704bfdd-e753-458e-8533-d3a8d632a866',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.987670] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b704bfdd-e753-458e-8533-d3a8d632a866 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.987812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.987888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.988147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.988353] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.988498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.988691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.988800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.989417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.989417] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b704bfdd-e753-458e-8533-d3a8d632a866',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.990423] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.990564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.990619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.992242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.992242] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1d904fd-a7a5-45af-a796-47dcf5bf2e4e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.490034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b704bfdd-e753-458e-8533-d3a8d632a866 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.490034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1194.490893] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b704bfdd-e753-458e-8533-d3a8d632a866',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.493851] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1d904fd-a7a5-45af-a796-47dcf5bf2e4e with status ACTIVE [ 1194.494078] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.494701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1194.494701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.494701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1194.494701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1194.494838] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.494838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1194.494934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.495018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1194.495170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1194.495263] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.495365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1194.495410] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.495551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1194.495627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1194.495708] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1d904fd-a7a5-45af-a796-47dcf5bf2e4e is going to be updated. [ 1194.515192] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.515335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1194.515400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.515631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1194.515766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1194.515928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1d904fd-a7a5-45af-a796-47dcf5bf2e4e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1194.997999] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b704bfdd-e753-458e-8533-d3a8d632a866',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.055704] env[62620]: INFO networking_nsxv3.common.synchronization [req-ad0958e4-ed7d-42c1-9da9-f9ee8daec69d req-74748658-4fe1-4509-a796-1b9c9883e58d tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_members [ 1195.056270] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_members [ 1195.056637] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84080db-2e0a-4513-addc-aca7401b2740 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.056788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.056856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.057185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.057547] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.057547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.057547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.057739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.057819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.058038] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.235306] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1195.237028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.237028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.237028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.237028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.237028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.237028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.237028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.237294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.237581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.237735] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.506172] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.506330] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.506405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.506630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.506740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.506917] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b704bfdd-e753-458e-8533-d3a8d632a866 is going to be created. [ 1195.535111] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.535111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.535111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.535279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.535353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.546531] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b704bfdd-e753-458e-8533-d3a8d632a866 in Status: UNINITIALIZED for 2s [ 1195.560830] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.561111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.561280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.561572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.561741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.562021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.562537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.562691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.562933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.563204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.563365] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84080db-2e0a-4513-addc-aca7401b2740 already deleted. [ 1195.563507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.574695] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.574892] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.575048] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.575343] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.575835] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.577196] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.577421] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.577734] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.577933] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.578213] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.578441] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.578621] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.578771] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.578922] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.579075] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.579251] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.603482] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.603674] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1195.603825] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.604021] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.604350] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-c9e055e0-0774-4741-a16c-139233d6803d taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.604530] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-c9e055e0-0774-4741-a16c-139233d6803d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.604658] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-c9e055e0-0774-4741-a16c-139233d6803d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.604988] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-c9e055e0-0774-4741-a16c-139233d6803d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.605150] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9e055e0-0774-4741-a16c-139233d6803d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.740327] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.740992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.740992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.740992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.740992] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.741160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.741160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.741285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.741379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.741502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.741663] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.741760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.741824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.742625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.742625] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.742625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.742625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.742625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.742625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.742625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.742625] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.111580] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.111933] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.111933] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.112269] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.112435] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.112600] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port c9e055e0-0774-4741-a16c-139233d6803d not found, creating... [ 1196.112879] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.113062] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.113191] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.113421] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.113568] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.113860] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.114034] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.114160] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.114374] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.114516] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.114664] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: c9e055e0-0774-4741-a16c-139233d6803d is going to be created. [ 1196.142024] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.142262] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.142436] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.142671] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.142922] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.143229] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-c9e055e0-0774-4741-a16c-139233d6803d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.245053] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5026804-13b5-4b49-b1b4-b00084a12c8c: rpc.has_security_group_logging(os_id): False [ 1196.268657] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.268657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.268657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.270202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.270416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.270704] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.270787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.270862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.271058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.271146] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.271388] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.271495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.271562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.271717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.271795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.272022] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.272159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.272226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.272433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.272520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.272682] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1196.343197] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.343345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.343563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.343634] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.343769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.359994] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1196.930275] env[62620]: INFO networking_nsxv3.common.synchronization [req-ad0958e4-ed7d-42c1-9da9-f9ee8daec69d req-9a8840bf-886e-4cb9-9e68-a281bcd8a3cb service nova] Enqueued Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_rules [ 1196.930444] env[62620]: INFO networking_nsxv3.common.synchronization [req-ad0958e4-ed7d-42c1-9da9-f9ee8daec69d req-9a8840bf-886e-4cb9-9e68-a281bcd8a3cb service nova] Enqueued Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_members [ 1196.930587] env[62620]: INFO networking_nsxv3.common.synchronization [req-ad0958e4-ed7d-42c1-9da9-f9ee8daec69d req-9a8840bf-886e-4cb9-9e68-a281bcd8a3cb service nova] Enqueued Resource ID: c9e055e0-0774-4741-a16c-139233d6803d with Priority: HIGHEST for action port [ 1196.930812] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_rules [ 1196.930939] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_members [ 1196.931042] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9e055e0-0774-4741-a16c-139233d6803d with Priority: HIGHEST for action port [ 1196.931581] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84080db-2e0a-4513-addc-aca7401b2740 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.931701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.931764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.931963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.932054] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.932856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84080db-2e0a-4513-addc-aca7401b2740 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.932969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.933039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.933187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.933326] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.933415] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.933472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.933605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.933683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.933788] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.935774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9e055e0-0774-4741-a16c-139233d6803d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.935774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9e055e0-0774-4741-a16c-139233d6803d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.935774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9e055e0-0774-4741-a16c-139233d6803d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.935774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9e055e0-0774-4741-a16c-139233d6803d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.935774] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9e055e0-0774-4741-a16c-139233d6803d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.177741] env[62620]: INFO networking_nsxv3.common.synchronization [req-a241d935-21a7-455c-8bd5-5e84db96ce79 req-4aa1ceaf-d3c2-4796-b097-076f5ea10b57 tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_members [ 1197.178287] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_members [ 1197.178822] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.178945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.179023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.179282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.179437] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.179538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.179602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.179748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.179834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.179924] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.444043] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84080db-2e0a-4513-addc-aca7401b2740 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.444043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.444043] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.444043] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9e055e0-0774-4741-a16c-139233d6803d with status ACTIVE [ 1197.444043] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.444043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.444043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.444043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.444043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.444043] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.444043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.444043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.444043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.444043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.446721] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.446721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.446721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.446721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.446721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.446721] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9e055e0-0774-4741-a16c-139233d6803d is going to be updated. [ 1197.465965] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.466128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.466226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.466423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.466574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.466770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9e055e0-0774-4741-a16c-139233d6803d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.511947] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-636 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.512222] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.512363] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.512624] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.512902] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.513230] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.513385] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.513611] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.513766] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.513980] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.514113] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1197.514230] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1197.514348] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1197.514464] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.514576] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1197.516318] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1197.540029] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1197.540029] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1197.540029] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1197.540029] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.540552] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-9a79e592-1487-4b96-93f2-66df8b0224a4 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.540834] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-9a79e592-1487-4b96-93f2-66df8b0224a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.541016] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-9a79e592-1487-4b96-93f2-66df8b0224a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.541385] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-9a79e592-1487-4b96-93f2-66df8b0224a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.541591] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a79e592-1487-4b96-93f2-66df8b0224a4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.554778] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b704bfdd-e753-458e-8533-d3a8d632a866 in Status: SUCCESS [ 1197.554996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.555170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.555391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.555587] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.555702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.555794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.555950] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.556040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.556110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.556172] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b704bfdd-e753-458e-8533-d3a8d632a866',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.682255] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.682495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.682569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.682852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.682958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.683228] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.683335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.683399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.683563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.683680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.683772] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d already deleted. [ 1197.683865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.946927] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.044055] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.047020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.047020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.047020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.047020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.047020] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 9a79e592-1487-4b96-93f2-66df8b0224a4 not found, creating... [ 1198.047020] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.047020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.047020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.047020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.047020] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.047690] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.047690] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.047690] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.048200] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.048200] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.048303] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 9a79e592-1487-4b96-93f2-66df8b0224a4 is going to be created. [ 1198.058100] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b704bfdd-e753-458e-8533-d3a8d632a866 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.058262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.058321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.058961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.058961] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.058961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.058961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.059157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.059157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.059272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.059385] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b704bfdd-e753-458e-8533-d3a8d632a866 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.059484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.060781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.060952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.061109] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.061205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.061268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.061408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.061482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.061560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.061646] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b704bfdd-e753-458e-8533-d3a8d632a866',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.069163] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.069163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.069163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.069163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.069163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.069163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-9a79e592-1487-4b96-93f2-66df8b0224a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.373964] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1198.374245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.452099] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.452318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.452391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.452604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.452683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.452791] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84080db-2e0a-4513-addc-aca7401b2740 is going to be created. [ 1198.473743] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.473941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.473941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.474239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.474363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.483680] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84080db-2e0a-4513-addc-aca7401b2740 in Status: UNINITIALIZED for 2s [ 1198.565752] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b704bfdd-e753-458e-8533-d3a8d632a866: rpc.has_security_group_logging(os_id): False [ 1198.583263] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.583469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.583530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.583933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.583933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.584077] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.584205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.584272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.584496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.584615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.584845] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.584952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.585052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.585220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.585313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.585606] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.585707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.585794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.585946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.586064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.586147] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b704bfdd-e753-458e-8533-d3a8d632a866 is going to be created. [ 1198.675664] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.675840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.675894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.676130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.676379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.689187] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b704bfdd-e753-458e-8533-d3a8d632a866 in Status: IN_PROGRESS for 2s [ 1199.016518] env[62620]: INFO networking_nsxv3.common.synchronization [req-7061ffc6-121c-40f8-b94f-c1227b20e94d req-d784f913-0778-4d40-b54c-6f783cc96cf2 tempest-ServersWithSpecificFlavorTestJSON-1227304686 tempest-ServersWithSpecificFlavorTestJSON-1227304686-project-member] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 1199.017372] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGHEST for action security_group_members [ 1199.017733] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.017873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.018025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.018207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.018374] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.019263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.019353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.019547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.019644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.019743] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.289439] env[62620]: INFO networking_nsxv3.common.synchronization [req-a241d935-21a7-455c-8bd5-5e84db96ce79 req-e2098f47-2cbe-42e0-9f6c-bfdd606e2463 service nova] Enqueued Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_rules [ 1199.289439] env[62620]: INFO networking_nsxv3.common.synchronization [req-a241d935-21a7-455c-8bd5-5e84db96ce79 req-e2098f47-2cbe-42e0-9f6c-bfdd606e2463 service nova] Enqueued Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_members [ 1199.290017] env[62620]: INFO networking_nsxv3.common.synchronization [req-a241d935-21a7-455c-8bd5-5e84db96ce79 req-e2098f47-2cbe-42e0-9f6c-bfdd606e2463 service nova] Enqueued Resource ID: 9a79e592-1487-4b96-93f2-66df8b0224a4 with Priority: HIGHEST for action port [ 1199.290510] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_rules [ 1199.290814] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_members [ 1199.291082] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a79e592-1487-4b96-93f2-66df8b0224a4 with Priority: HIGHEST for action port [ 1199.294065] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.294065] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.294065] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.294065] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.294065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.294065] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.295490] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a79e592-1487-4b96-93f2-66df8b0224a4 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.295836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a79e592-1487-4b96-93f2-66df8b0224a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.296036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a79e592-1487-4b96-93f2-66df8b0224a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.296397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a79e592-1487-4b96-93f2-66df8b0224a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.296586] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a79e592-1487-4b96-93f2-66df8b0224a4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.524878] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.524878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.524878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.524878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.524878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.524878] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.524878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.524878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.524878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.524878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.524878] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f is going to be updated. [ 1199.554921] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.555132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.555169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.555522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.555647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.564757] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: IN_PROGRESS for 2s [ 1199.798929] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.800074] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.800202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.800618] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a79e592-1487-4b96-93f2-66df8b0224a4 with status ACTIVE [ 1199.800795] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.800917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.801018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.801267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.801370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.801569] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.801689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.801761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.801940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.802028] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.802263] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.802331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.802434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.802549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.802630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.802737] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a79e592-1487-4b96-93f2-66df8b0224a4 is going to be updated. [ 1199.822656] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.822823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.822882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.823097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.823256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.823402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a79e592-1487-4b96-93f2-66df8b0224a4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.302560] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.495686] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84080db-2e0a-4513-addc-aca7401b2740 in Status: SUCCESS [ 1200.495907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.496091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.496308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.496308] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.496308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.496843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.496843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.496914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.496990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.497087] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.699714] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b704bfdd-e753-458e-8533-d3a8d632a866 in Status: SUCCESS [ 1200.700014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.806364] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.806555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.806631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.806868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.806963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.807090] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d is going to be created. [ 1200.829447] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.829624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.829674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.829975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.830238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.839379] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d in Status: UNINITIALIZED for 2s [ 1201.002545] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.504980] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84080db-2e0a-4513-addc-aca7401b2740: rpc.has_security_group_logging(os_id): False [ 1201.523993] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.523993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1201.523993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.523993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1201.523993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1201.523993] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.523993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1201.523993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.524326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1201.524326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1201.524326] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84080db-2e0a-4513-addc-aca7401b2740 is going to be created. [ 1201.573297] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f in Status: SUCCESS [ 1201.573562] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f deletion is rescheduled due to dependency. [ 1201.573642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1201.587907] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.588087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1201.588221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.588400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1201.588586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1201.598085] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84080db-2e0a-4513-addc-aca7401b2740 in Status: IN_PROGRESS for 2s [ 1201.921561] env[62620]: INFO networking_nsxv3.common.synchronization [req-94fd37cb-1bf0-4a2a-b9bb-62e8d018ae92 req-9345f554-ccdf-461a-a91e-13dd9506e9a8 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1201.923043] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1201.923043] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.923043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1201.923043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.923043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1201.923633] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.923633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1201.923633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.923633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1201.923895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1201.923895] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.314536] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.314790] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1202.315392] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.315392] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.315498] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.315599] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1202.315723] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.315941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.316104] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.316320] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.316671] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1202.316671] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1202.316671] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1202.316783] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.316882] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1202.317030] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1202.336469] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1202.336643] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1202.336789] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1202.336971] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.337292] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-3166f86b-c852-4335-9c18-b4c68f51d8ab taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.337467] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-3166f86b-c852-4335-9c18-b4c68f51d8ab" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1202.337611] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-3166f86b-c852-4335-9c18-b4c68f51d8ab" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.337979] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-3166f86b-c852-4335-9c18-b4c68f51d8ab" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.338150] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3166f86b-c852-4335-9c18-b4c68f51d8ab',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.426611] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.840755] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.841079] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1202.841271] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.841608] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.841813] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.842049] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 3166f86b-c852-4335-9c18-b4c68f51d8ab not found, creating... [ 1202.842516] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.842613] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1202.842790] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.843124] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.843336] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.843725] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.843954] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1202.844145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.844425] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.844631] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.844831] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 3166f86b-c852-4335-9c18-b4c68f51d8ab is going to be created. [ 1202.854972] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d in Status: SUCCESS [ 1202.855192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.855342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.855526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.855700] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.855813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1202.855868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.856031] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.856097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.856191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.856280] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.863732] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.863940] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1202.864084] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.864328] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.864553] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.864773] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-3166f86b-c852-4335-9c18-b4c68f51d8ab" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.931427] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.358877] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.434296] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.434406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1203.434440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.434665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1203.435041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1203.435041] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 is going to be updated. [ 1203.461629] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.462115] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1203.462201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.462585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1203.462784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1203.471124] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: IN_PROGRESS for 2s [ 1203.612754] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84080db-2e0a-4513-addc-aca7401b2740 in Status: SUCCESS [ 1203.613071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1203.736544] env[62620]: INFO networking_nsxv3.common.synchronization [req-94fd37cb-1bf0-4a2a-b9bb-62e8d018ae92 req-f14c8da4-cd01-41e6-926d-23bf57569dc8 service nova] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_rules [ 1203.736544] env[62620]: INFO networking_nsxv3.common.synchronization [req-94fd37cb-1bf0-4a2a-b9bb-62e8d018ae92 req-f14c8da4-cd01-41e6-926d-23bf57569dc8 service nova] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1203.736544] env[62620]: INFO networking_nsxv3.common.synchronization [req-94fd37cb-1bf0-4a2a-b9bb-62e8d018ae92 req-f14c8da4-cd01-41e6-926d-23bf57569dc8 service nova] Enqueued Resource ID: 3166f86b-c852-4335-9c18-b4c68f51d8ab with Priority: HIGHEST for action port [ 1203.737497] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_rules [ 1203.740634] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1203.742749] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3166f86b-c852-4335-9c18-b4c68f51d8ab with Priority: HIGHEST for action port [ 1203.743116] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.744048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1203.744048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.744048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1203.744048] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.744676] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.744779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1203.745043] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-3166f86b-c852-4335-9c18-b4c68f51d8ab taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.745206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3166f86b-c852-4335-9c18-b4c68f51d8ab" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1203.745307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3166f86b-c852-4335-9c18-b4c68f51d8ab" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.745588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3166f86b-c852-4335-9c18-b4c68f51d8ab" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1203.746151] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3166f86b-c852-4335-9c18-b4c68f51d8ab',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.861016] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d: rpc.has_security_group_logging(os_id): False [ 1203.880610] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.880845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1203.880965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.881286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1203.881424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1203.881812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.881969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1203.882092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.882343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1203.882426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1203.882556] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d is going to be created. [ 1203.947278] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.947599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1203.948012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.948307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1203.948491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1203.958941] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d in Status: IN_PROGRESS for 2s [ 1204.247911] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.248062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.248274] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3166f86b-c852-4335-9c18-b4c68f51d8ab with status ACTIVE [ 1204.248452] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.248604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.248706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.248930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.249035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.249209] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.249321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.249367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.249527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.249606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.249794] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.249944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.250021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.250164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.250239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.250324] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3166f86b-c852-4335-9c18-b4c68f51d8ab is going to be updated. [ 1204.274789] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.275075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.275075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.275164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.275275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.275427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3166f86b-c852-4335-9c18-b4c68f51d8ab" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.480348] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: SUCCESS [ 1205.480628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.480727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.480952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.481159] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.481273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.481358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.481607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.481673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.481824] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.970931] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d in Status: SUCCESS [ 1205.970931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.985014] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.486140] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.529993] env[62620]: INFO networking_nsxv3.common.synchronization [req-47083594-eb12-4bb4-a09f-9c04167581bb req-ca274369-bb07-4f87-b198-1d84cf0a2da9 tempest-ServerMetadataNegativeTestJSON-1118921947 tempest-ServerMetadataNegativeTestJSON-1118921947-project-member] Enqueued Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGHEST for action security_group_members [ 1206.530667] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGHEST for action security_group_members [ 1206.531358] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b704bfdd-e753-458e-8533-d3a8d632a866 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.531493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.531563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.531800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.532060] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.532216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.532319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.532535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.532671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.532809] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b704bfdd-e753-458e-8533-d3a8d632a866',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.989347] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.989518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.989557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.990025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.990131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.990247] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 is going to be updated. [ 1207.017089] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.017261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.017301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.017563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.017840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.026715] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: IN_PROGRESS for 2s [ 1207.035247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.035406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.035481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.036458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.036572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.036778] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.036886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.036953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.037145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.037228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.037319] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b704bfdd-e753-458e-8533-d3a8d632a866 is going to be updated. [ 1207.062549] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.062732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.062866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.062996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.063091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.070910] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b704bfdd-e753-458e-8533-d3a8d632a866 in Status: IN_PROGRESS for 2s [ 1207.287317] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.287682] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.287855] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.288180] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.289021] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.289269] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.289412] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.289690] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.289926] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.290133] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.290276] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.290406] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.290523] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.290665] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.290780] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.290933] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.311180] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.313796] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1207.313796] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.313796] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-496" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.313989] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-823150e9-f3ee-44ab-a36b-c8abdca8b70e taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.314191] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.314322] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.314602] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.314745] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('823150e9-f3ee-44ab-a36b-c8abdca8b70e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.819453] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.819822] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.820055] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.820516] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.820758] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.821242] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.821502] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.821698] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.822047] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.822289] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.822725] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.822979] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.823190] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.823507] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.823730] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.823958] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 823150e9-f3ee-44ab-a36b-c8abdca8b70e is going to be updated. [ 1207.845198] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.845198] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.845378] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.845636] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.845941] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.846290] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.823613] env[62620]: INFO networking_nsxv3.common.synchronization [req-db6fe6e2-1a5b-4694-ab8a-c03b03dea031 req-9f2a2faa-60fa-4b9e-827b-9240fe07e577 service nova] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_rules [ 1208.823904] env[62620]: INFO networking_nsxv3.common.synchronization [req-db6fe6e2-1a5b-4694-ab8a-c03b03dea031 req-9f2a2faa-60fa-4b9e-827b-9240fe07e577 service nova] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1208.823976] env[62620]: INFO networking_nsxv3.common.synchronization [req-db6fe6e2-1a5b-4694-ab8a-c03b03dea031 req-9f2a2faa-60fa-4b9e-827b-9240fe07e577 service nova] Enqueued Resource ID: 823150e9-f3ee-44ab-a36b-c8abdca8b70e with Priority: HIGHEST for action port [ 1208.824488] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_rules [ 1208.824625] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1208.824734] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823150e9-f3ee-44ab-a36b-c8abdca8b70e with Priority: HIGHEST for action port [ 1208.825119] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.825281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.825384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.825791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.825791] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.826718] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.827931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.828063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.828310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.828652] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.829135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.829135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.829596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.829596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.829596] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.830432] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-823150e9-f3ee-44ab-a36b-c8abdca8b70e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.831347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.831492] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.831751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.831987] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('823150e9-f3ee-44ab-a36b-c8abdca8b70e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.044839] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: SUCCESS [ 1209.045094] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.045331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.045545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.045787] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.045907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.046042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.046172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.047025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.047025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.047025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.082643] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b704bfdd-e753-458e-8533-d3a8d632a866 in Status: SUCCESS [ 1209.082870] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b704bfdd-e753-458e-8533-d3a8d632a866 deletion is rescheduled due to dependency. [ 1209.082988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.334850] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.335041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.335195] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.336093] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 823150e9-f3ee-44ab-a36b-c8abdca8b70e with status ACTIVE [ 1209.336281] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.336412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.336468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.336666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.336755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.336931] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.337043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.337107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.337259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.337356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.337582] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.337709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.337771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.337969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.338315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.338477] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 823150e9-f3ee-44ab-a36b-c8abdca8b70e is going to be updated. [ 1209.357375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.357539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.357572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.357869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.358087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.358258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-823150e9-f3ee-44ab-a36b-c8abdca8b70e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.548941] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.840141] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.051585] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f23bc15-3356-4a60-a94f-750f1fd18026: rpc.has_security_group_logging(os_id): False [ 1210.069020] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.069138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.069138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.069398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.069534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.069833] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.069963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.070099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.070285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.070365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.070458] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 is going to be updated. [ 1210.123648] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.123809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.123884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.124132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.124329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.135543] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: IN_PROGRESS for 2s [ 1210.342468] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.342468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.342648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.342744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.342855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.342990] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be updated. [ 1210.373096] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.373274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.373331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.373527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.373677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.382480] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: IN_PROGRESS for 2s [ 1212.149311] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: SUCCESS [ 1212.149645] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.392638] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1212.392911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.393137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.393402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.393638] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.393785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.393868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.394152] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.394273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.394387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.394501] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.900164] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.900164] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.900164] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.900164] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.900164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.901250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.901250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.901250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.901250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.901250] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.337936] env[62620]: INFO networking_nsxv3.common.synchronization [None req-a7e465dd-44cb-49a6-b4b6-4d19cda57c07 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1213.338477] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1213.338759] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.338890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.338960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.339261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.339428] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.339531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.339595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.340466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.340566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.340666] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.403947] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c76585c-33d4-4740-aca6-cc740735e2c9: rpc.has_security_group_logging(os_id): False [ 1213.422103] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.422259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.422332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.422543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.422636] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.422841] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.422941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.423010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.423172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.423249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.423434] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.423530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.423592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.423732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.423809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.424011] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.424787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.424787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.424787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.424927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.424958] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be updated. [ 1213.480917] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.481133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.481229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.481494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.481688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.495997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: IN_PROGRESS for 2s [ 1213.843239] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.843651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.843651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.843651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.843959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.843959] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.845274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.845274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.845274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.845274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.845274] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be deleted. [ 1213.870810] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.870810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.870810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.870810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.870810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.870810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1215.511069] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1215.511451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.575455] env[62620]: INFO networking_nsxv3.common.synchronization [None req-c80508f8-d36d-4ba8-980e-a51e2fff51d1 None None] Enqueued Resource ID: 22396ea1-7c73-4e95-8a92-6a51216745d6 with Priority: HIGHEST for action port [ 1217.576912] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22396ea1-7c73-4e95-8a92-6a51216745d6 with Priority: HIGHEST for action port [ 1217.577659] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-22396ea1-7c73-4e95-8a92-6a51216745d6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.578076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22396ea1-7c73-4e95-8a92-6a51216745d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.578217] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22396ea1-7c73-4e95-8a92-6a51216745d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.578518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22396ea1-7c73-4e95-8a92-6a51216745d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.578607] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22396ea1-7c73-4e95-8a92-6a51216745d6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.081826] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22396ea1-7c73-4e95-8a92-6a51216745d6 [ 1218.082110] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.082278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.082349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.082553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.082642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.082733] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22396ea1-7c73-4e95-8a92-6a51216745d6 already deleted. [ 1218.082812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22396ea1-7c73-4e95-8a92-6a51216745d6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1219.525646] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d16b14bd-e8f5-4563-aa48-0b4719394ba4 None None] Enqueued Resource ID: 667179f5-d0bf-4bdb-b51a-8546542dd616 with Priority: HIGHEST for action port [ 1219.526354] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667179f5-d0bf-4bdb-b51a-8546542dd616 with Priority: HIGHEST for action port [ 1219.526682] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-667179f5-d0bf-4bdb-b51a-8546542dd616 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.526807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-667179f5-d0bf-4bdb-b51a-8546542dd616" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1219.526877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-667179f5-d0bf-4bdb-b51a-8546542dd616" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.528972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-667179f5-d0bf-4bdb-b51a-8546542dd616" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1219.529191] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('667179f5-d0bf-4bdb-b51a-8546542dd616',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.817455] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d551e89f-969f-48c1-b9ef-96748f16eb37 None None] Enqueued Resource ID: 74a0a62b-7c5d-496e-b8c2-2d140b4505e8 with Priority: HIGHEST for action port [ 1219.818962] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a0a62b-7c5d-496e-b8c2-2d140b4505e8 with Priority: HIGHEST for action port [ 1219.822479] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-74a0a62b-7c5d-496e-b8c2-2d140b4505e8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.822984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74a0a62b-7c5d-496e-b8c2-2d140b4505e8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1219.823124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74a0a62b-7c5d-496e-b8c2-2d140b4505e8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.823418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74a0a62b-7c5d-496e-b8c2-2d140b4505e8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1219.823509] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a0a62b-7c5d-496e-b8c2-2d140b4505e8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.031994] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 667179f5-d0bf-4bdb-b51a-8546542dd616 [ 1220.032409] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.032677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1220.032677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.032908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1220.033011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1220.033119] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:667179f5-d0bf-4bdb-b51a-8546542dd616 already deleted. [ 1220.033255] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-667179f5-d0bf-4bdb-b51a-8546542dd616" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1220.327462] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74a0a62b-7c5d-496e-b8c2-2d140b4505e8 [ 1220.327980] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.328171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1220.328239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.328455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1220.328555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1220.328760] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74a0a62b-7c5d-496e-b8c2-2d140b4505e8 already deleted. [ 1220.328760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74a0a62b-7c5d-496e-b8c2-2d140b4505e8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.518516] env[62620]: INFO networking_nsxv3.common.synchronization [req-8d983870-b855-437a-870d-14bed5fd002a req-7d09871e-8738-45d4-831c-1fe5606a842b tempest-ServerActionsTestOtherB-764568701 tempest-ServerActionsTestOtherB-764568701-project-member] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1221.519077] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1221.519724] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.519724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.519724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.519908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.520665] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.520887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.520969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.521252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.521422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.521528] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.026563] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.026995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.026995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.027453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.027453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.027588] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.027588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.027704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.027875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.027963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.028820] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1222.057491] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.060023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.060023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.060023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.060023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.067014] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1222.604386] env[62620]: INFO networking_nsxv3.common.synchronization [None req-79bd4c23-6c3d-4037-b651-59a5531e3cb4 None None] Enqueued Resource ID: cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2 with Priority: HIGHEST for action port [ 1222.604386] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2 with Priority: HIGHEST for action port [ 1222.605748] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.605748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.605748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.605748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.605748] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.108533] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2 [ 1223.108843] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.108978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1223.109084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.109272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1223.109362] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1223.109459] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2 already deleted. [ 1223.109617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd2b87bf-d5d7-479e-9fb7-48362dbb2ef2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1223.616559] env[62620]: INFO networking_nsxv3.common.synchronization [req-1aaba5e8-a913-4389-8d36-93d888907507 req-38ce350d-5052-4506-a2fb-581d8c62f1cf tempest-ServerActionsV293TestJSON-856706501 tempest-ServerActionsV293TestJSON-856706501-project-member] Enqueued Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_members [ 1223.617492] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGHEST for action security_group_members [ 1223.618057] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20781892-13fd-4ddf-8c97-ac90186655e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.618283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1223.618443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.618817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1223.619090] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.619290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1223.619409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.619702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1223.619878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1223.620066] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.079412] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1224.079937] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 deletion is rescheduled due to dependency. [ 1224.080300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.125663] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.125856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.125917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.126259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.126361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.126730] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.126730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.126730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.126884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.126940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.127046] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20781892-13fd-4ddf-8c97-ac90186655e0 is going to be updated. [ 1224.151809] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.152664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.152794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.153161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.153387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.161068] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20781892-13fd-4ddf-8c97-ac90186655e0 in Status: IN_PROGRESS for 2s [ 1224.849905] env[62620]: INFO networking_nsxv3.common.synchronization [req-33f0529e-10e3-4ee4-a217-4d92cb06fd7c req-99b0e241-412a-4163-b021-21417c6ab495 tempest-FloatingIPsAssociationNegativeTestJSON-1740626313 tempest-FloatingIPsAssociationNegativeTestJSON-1740626313-project-member] Enqueued Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGHEST for action security_group_members [ 1224.850293] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGHEST for action security_group_members [ 1224.850596] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-522dbe7d-0c4e-456f-9be7-2144d27ebc47 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.850718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.850874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.851633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.851633] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.851633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.851633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.851883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.851883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.851883] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522dbe7d-0c4e-456f-9be7-2144d27ebc47',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.162022] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.162252] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-581" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.162437] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-581" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.162969] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-581" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.163392] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.163743] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.163813] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.164087] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.164282] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.164540] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1225.164752] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1225.164844] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1225.165011] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1225.165217] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1225.165377] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1225.165587] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1225.184635] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1225.184845] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1225.184992] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1225.185196] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-581" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.185516] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.185690] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.185817] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.186160] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.186309] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('200bba8f-ca22-4dfa-9492-f4d2f2e6f212',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.356029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.356029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.356029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.356204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.356204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.356401] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.356646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.356646] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.356713] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.357134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.357134] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 already deleted. [ 1225.357134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.690035] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.690035] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.690035] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.690280] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.690375] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.690839] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 200bba8f-ca22-4dfa-9492-f4d2f2e6f212 not found, creating... [ 1225.690926] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.691100] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.691239] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.691498] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.691652] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.691994] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.692230] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.692607] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.692607] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.692684] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.692838] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 200bba8f-ca22-4dfa-9492-f4d2f2e6f212 is going to be created. [ 1225.715079] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.715079] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.715079] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.715079] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.715079] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.715079] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1226.172229] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20781892-13fd-4ddf-8c97-ac90186655e0 in Status: SUCCESS [ 1226.172653] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20781892-13fd-4ddf-8c97-ac90186655e0 deletion is rescheduled due to dependency. [ 1226.173043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1226.899484] env[62620]: INFO networking_nsxv3.common.synchronization [req-33f0529e-10e3-4ee4-a217-4d92cb06fd7c req-47b3d3a5-d53c-43f7-833d-5457b0fddcbe service nova] Enqueued Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGHEST for action security_group_rules [ 1226.899800] env[62620]: INFO networking_nsxv3.common.synchronization [req-33f0529e-10e3-4ee4-a217-4d92cb06fd7c req-47b3d3a5-d53c-43f7-833d-5457b0fddcbe service nova] Enqueued Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGHEST for action security_group_members [ 1226.900331] env[62620]: INFO networking_nsxv3.common.synchronization [req-33f0529e-10e3-4ee4-a217-4d92cb06fd7c req-47b3d3a5-d53c-43f7-833d-5457b0fddcbe service nova] Enqueued Resource ID: 200bba8f-ca22-4dfa-9492-f4d2f2e6f212 with Priority: HIGHEST for action port [ 1226.901044] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGHEST for action security_group_rules [ 1226.901303] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGHEST for action security_group_members [ 1226.901513] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200bba8f-ca22-4dfa-9492-f4d2f2e6f212 with Priority: HIGHEST for action port [ 1226.901970] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.902226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1226.902400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.902813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1226.902996] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('522dbe7d-0c4e-456f-9be7-2144d27ebc47',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.905322] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-522dbe7d-0c4e-456f-9be7-2144d27ebc47 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.905322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1226.905322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.905623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1226.905919] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.906237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1226.906386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.906670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1226.906840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1226.907014] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522dbe7d-0c4e-456f-9be7-2144d27ebc47',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.908534] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.908651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1226.908760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.908963] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1226.909083] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('200bba8f-ca22-4dfa-9492-f4d2f2e6f212',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.406033] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-522dbe7d-0c4e-456f-9be7-2144d27ebc47 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.406395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.409669] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('522dbe7d-0c4e-456f-9be7-2144d27ebc47',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.414540] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 200bba8f-ca22-4dfa-9492-f4d2f2e6f212 with status ACTIVE [ 1227.414763] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.414887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.414961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.415193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.415287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.415474] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.415565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.415630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.415778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.415857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.416039] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.416137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.416196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.416336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.416404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.416490] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 200bba8f-ca22-4dfa-9492-f4d2f2e6f212 is going to be updated. [ 1227.450190] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.450369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.450482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.450652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.450787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.450950] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-200bba8f-ca22-4dfa-9492-f4d2f2e6f212" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.916108] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('522dbe7d-0c4e-456f-9be7-2144d27ebc47',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.342114] env[62620]: INFO networking_nsxv3.common.synchronization [None req-2931bb5e-9f89-42bb-b2a7-2508abe48543 None None] Enqueued Resource ID: a30c4ef9-07ec-4c57-8444-2d551df4b9cd with Priority: HIGHEST for action port [ 1228.342714] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a30c4ef9-07ec-4c57-8444-2d551df4b9cd with Priority: HIGHEST for action port [ 1228.343072] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-a30c4ef9-07ec-4c57-8444-2d551df4b9cd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.343225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a30c4ef9-07ec-4c57-8444-2d551df4b9cd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.343318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a30c4ef9-07ec-4c57-8444-2d551df4b9cd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.343569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a30c4ef9-07ec-4c57-8444-2d551df4b9cd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.343649] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a30c4ef9-07ec-4c57-8444-2d551df4b9cd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.384190] env[62620]: INFO networking_nsxv3.common.synchronization [req-aad0a566-72e9-4176-b1ec-db4c50310d30 req-9445d13f-350d-451a-81e2-666a589c9d50 tempest-ServerPasswordTestJSON-887539007 tempest-ServerPasswordTestJSON-887539007-project-member] Enqueued Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGHEST for action security_group_members [ 1228.384700] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGHEST for action security_group_members [ 1228.385252] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-401d776d-874d-46cf-ad91-06222d321584 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.385391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.385480] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.385770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.385958] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.386201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.387036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.387036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.387036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.387036] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401d776d-874d-46cf-ad91-06222d321584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.569938] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.570371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.570371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.570491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.570642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.570713] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 is going to be created. [ 1228.593771] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.593910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.593986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.594206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.594366] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.603273] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 in Status: UNINITIALIZED for 2s [ 1228.727500] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.727717] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-958" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.727855] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-958" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.728268] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-958" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.728550] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.728712] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.728858] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.731246] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.731461] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.731710] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1228.731838] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.731959] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.732104] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1228.732228] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1228.732354] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1228.732518] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1228.758204] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1228.758414] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1228.758574] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1228.758781] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-958" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.759606] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-98d518c4-51bc-4451-a4d2-6bd21f656d3d taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.759606] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-98d518c4-51bc-4451-a4d2-6bd21f656d3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.759606] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-98d518c4-51bc-4451-a4d2-6bd21f656d3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.759868] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-98d518c4-51bc-4451-a4d2-6bd21f656d3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.760204] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d518c4-51bc-4451-a4d2-6bd21f656d3d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.849346] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a30c4ef9-07ec-4c57-8444-2d551df4b9cd [ 1228.849624] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.849756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.849834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.850134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.850262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.850365] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a30c4ef9-07ec-4c57-8444-2d551df4b9cd already deleted. [ 1228.850445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a30c4ef9-07ec-4c57-8444-2d551df4b9cd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.889082] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.889327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.889390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.889670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.889833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.890279] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.890279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.890443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.890489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.890828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.890828] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401d776d-874d-46cf-ad91-06222d321584 already deleted. [ 1228.890828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.263036] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.263412] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.265882] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.265882] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.265882] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.265882] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 98d518c4-51bc-4451-a4d2-6bd21f656d3d not found, creating... [ 1229.265882] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.265882] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.265882] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.265882] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.265882] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.265882] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.266199] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.266199] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.270153] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.271474] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.271474] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 98d518c4-51bc-4451-a4d2-6bd21f656d3d is going to be created. [ 1229.293066] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.293322] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.293455] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.293746] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.293991] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.294246] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-98d518c4-51bc-4451-a4d2-6bd21f656d3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.179916] env[62620]: INFO networking_nsxv3.common.synchronization [req-aad0a566-72e9-4176-b1ec-db4c50310d30 req-2a143e5b-e28f-4f86-86a6-326e43e58721 service nova] Enqueued Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGHEST for action security_group_rules [ 1230.180183] env[62620]: INFO networking_nsxv3.common.synchronization [req-aad0a566-72e9-4176-b1ec-db4c50310d30 req-2a143e5b-e28f-4f86-86a6-326e43e58721 service nova] Enqueued Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGHEST for action security_group_members [ 1230.180277] env[62620]: INFO networking_nsxv3.common.synchronization [req-aad0a566-72e9-4176-b1ec-db4c50310d30 req-2a143e5b-e28f-4f86-86a6-326e43e58721 service nova] Enqueued Resource ID: 98d518c4-51bc-4451-a4d2-6bd21f656d3d with Priority: HIGHEST for action port [ 1230.180515] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGHEST for action security_group_rules [ 1230.180651] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGHEST for action security_group_members [ 1230.180743] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98d518c4-51bc-4451-a4d2-6bd21f656d3d with Priority: HIGHEST for action port [ 1230.181910] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401d776d-874d-46cf-ad91-06222d321584 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.182207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.182318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.182894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.183022] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401d776d-874d-46cf-ad91-06222d321584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.184890] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-401d776d-874d-46cf-ad91-06222d321584 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.184890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.184890] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.185145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.185420] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.185420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.185514] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.185672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.185780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.185885] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401d776d-874d-46cf-ad91-06222d321584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.188080] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-98d518c4-51bc-4451-a4d2-6bd21f656d3d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.188504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98d518c4-51bc-4451-a4d2-6bd21f656d3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.188606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98d518c4-51bc-4451-a4d2-6bd21f656d3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.188802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98d518c4-51bc-4451-a4d2-6bd21f656d3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.188935] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d518c4-51bc-4451-a4d2-6bd21f656d3d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.612708] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 in Status: SUCCESS [ 1230.612708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.612708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.612858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.616019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.616019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.616019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.616019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.616019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.616019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.616019] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('522dbe7d-0c4e-456f-9be7-2144d27ebc47',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.691603] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('401d776d-874d-46cf-ad91-06222d321584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.693273] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-401d776d-874d-46cf-ad91-06222d321584 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.693511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.693753] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98d518c4-51bc-4451-a4d2-6bd21f656d3d with status ACTIVE [ 1230.694313] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.695063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.695063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.695436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.698243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.698243] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.698243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.698243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.698243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.698243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.698243] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.698243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.698243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.698794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.698794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.698794] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98d518c4-51bc-4451-a4d2-6bd21f656d3d is going to be updated. [ 1230.721252] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.721437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.721437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.721594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.721773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.721990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98d518c4-51bc-4451-a4d2-6bd21f656d3d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.116644] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-522dbe7d-0c4e-456f-9be7-2144d27ebc47 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.116856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.116856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.116973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.117167] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.117275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.117341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.117538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.117626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.117717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.117879] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-522dbe7d-0c4e-456f-9be7-2144d27ebc47 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.117993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.118065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.118209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.118350] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.118443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.118503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.118640] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.118716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.118794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.118896] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('522dbe7d-0c4e-456f-9be7-2144d27ebc47',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.201606] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('401d776d-874d-46cf-ad91-06222d321584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.620931] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 522dbe7d-0c4e-456f-9be7-2144d27ebc47: rpc.has_security_group_logging(os_id): False [ 1231.638958] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.640027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.640027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.640027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.640027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.640027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.640027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.640340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.640340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.640340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.640491] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.640597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.640661] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.640804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.640908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.641115] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.641228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.641377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.641432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.641497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.641604] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 is going to be created. [ 1231.698727] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.698875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.698920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.699187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.699378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.704176] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.704316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.704374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.704558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.704662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.704758] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401d776d-874d-46cf-ad91-06222d321584 is going to be created. [ 1231.708762] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 in Status: IN_PROGRESS for 2s [ 1231.727041] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.727041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.727206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.727359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.727550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.737145] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401d776d-874d-46cf-ad91-06222d321584 in Status: UNINITIALIZED for 2s [ 1232.761658] env[62620]: INFO networking_nsxv3.common.synchronization [req-0a59b3e6-07f2-4be8-936f-ca25e2fd0c04 req-d09baeea-c864-4953-8a56-14e59e1515e4 tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1232.761658] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1232.761658] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.761658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.761658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.761658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.762745] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.762745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.762745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.762745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.762745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.762745] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.265362] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.265522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1233.265522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.265736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1233.266017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.266282] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.266402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1233.266471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.266678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1233.266772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.267521] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1233.295028] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.295179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1233.295253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.295466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1233.295604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.303549] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1233.723240] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 in Status: SUCCESS [ 1233.723573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.749019] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401d776d-874d-46cf-ad91-06222d321584 in Status: SUCCESS [ 1233.749283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.749458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.749722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1233.749920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.750051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1233.750133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.750401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1233.750504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.750594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.750686] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('401d776d-874d-46cf-ad91-06222d321584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.231189] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.231504] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.231547] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.231819] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.232118] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.232288] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.232415] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.232634] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.232880] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.233163] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.233306] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.233427] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.233545] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.233667] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.233777] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.233920] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.254025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-401d776d-874d-46cf-ad91-06222d321584 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.254025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.254025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.254025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.254025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.254025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.254025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.254025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.254430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.254430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.254430] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-401d776d-874d-46cf-ad91-06222d321584 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.254430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.254538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.254612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.254736] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.254820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.254876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.255023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.255099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.255177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.255259] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('401d776d-874d-46cf-ad91-06222d321584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.261633] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.261860] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1234.261986] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.262604] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.262705] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-1034439a-d24f-4eb6-8139-67b012254146 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.263691] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.263691] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.263691] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.263691] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1034439a-d24f-4eb6-8139-67b012254146',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.757701] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 401d776d-874d-46cf-ad91-06222d321584: rpc.has_security_group_logging(os_id): False [ 1234.765744] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.765972] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.766123] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.766418] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.766581] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.766741] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 1034439a-d24f-4eb6-8139-67b012254146 not found, creating... [ 1234.767026] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.767268] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.767404] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.767642] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.767789] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.768168] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.768485] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.768527] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.768716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.768858] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.769115] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 1034439a-d24f-4eb6-8139-67b012254146 is going to be created. [ 1234.777391] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.777391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.777391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.777391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.777391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.777613] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.777613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.777680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.777812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.777885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.778152] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.778251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.778312] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.778455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.778529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.778704] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.779098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.779098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.779098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.779098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.779301] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401d776d-874d-46cf-ad91-06222d321584 is going to be created. [ 1234.798361] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.798598] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.798598] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.798854] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.799102] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.799341] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.879414] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.879572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.879671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.879842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.880120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.899506] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401d776d-874d-46cf-ad91-06222d321584 in Status: IN_PROGRESS for 2s [ 1235.312052] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1235.312426] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c deletion is rescheduled due to dependency. [ 1235.312426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.681901] env[62620]: INFO networking_nsxv3.common.synchronization [req-5fad0098-843f-499a-a490-4d957e83cb48 req-08ca8cc0-3200-4644-85ee-7e54c29bed2c service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 1235.682192] env[62620]: INFO networking_nsxv3.common.synchronization [req-5fad0098-843f-499a-a490-4d957e83cb48 req-08ca8cc0-3200-4644-85ee-7e54c29bed2c service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1235.682382] env[62620]: INFO networking_nsxv3.common.synchronization [req-5fad0098-843f-499a-a490-4d957e83cb48 req-08ca8cc0-3200-4644-85ee-7e54c29bed2c service nova] Enqueued Resource ID: 1034439a-d24f-4eb6-8139-67b012254146 with Priority: HIGHEST for action port [ 1235.682693] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 1235.682766] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1235.682933] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1034439a-d24f-4eb6-8139-67b012254146 with Priority: HIGHEST for action port [ 1235.683420] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.683535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.683616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.683806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.683887] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.688806] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.688949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.689000] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.689188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.689345] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.689458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.689498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.689656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.689748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.689838] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.690646] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-1034439a-d24f-4eb6-8139-67b012254146 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.690753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.690820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.690972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.691068] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1034439a-d24f-4eb6-8139-67b012254146',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.694865] env[62620]: INFO networking_nsxv3.common.synchronization [req-7adf3789-ecdb-4d6c-9a3a-650ca2f658c8 req-80166ec6-db8e-4cec-8ee2-f7c1e22693f4 tempest-ServerActionsTestOtherB-764568701 tempest-ServerActionsTestOtherB-764568701-project-member] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1235.694865] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1235.695068] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.695150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.695247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.695381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.695522] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.696220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.696220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.696220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.696220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.696220] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.167735] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.167735] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.167735] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.168145] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.169224] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.169224] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.169224] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.169224] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.169224] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.169572] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.169572] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.169572] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.169656] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.169777] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.169909] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.170064] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.188215] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.188215] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1236.188215] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.189232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.189232] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-57af03b0-8d4d-4f61-a384-800617af9be4 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.189232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-57af03b0-8d4d-4f61-a384-800617af9be4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.189232] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-57af03b0-8d4d-4f61-a384-800617af9be4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.189422] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-57af03b0-8d4d-4f61-a384-800617af9be4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.189534] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57af03b0-8d4d-4f61-a384-800617af9be4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.193738] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.193738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.193738] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.193738] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1034439a-d24f-4eb6-8139-67b012254146 with status ACTIVE [ 1236.194058] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.194058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.194058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.195034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.195034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.195034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.195034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.195034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.195034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.195034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.195358] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.195358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.195358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.195358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.195577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.195577] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1034439a-d24f-4eb6-8139-67b012254146 is going to be updated. [ 1236.197431] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.197556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.197615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.197827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.197903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.198063] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.198346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.198346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.198460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.198460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.198537] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1236.216015] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.216228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.216298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.216502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.216632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.216776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.227976] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.227976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.227976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.227976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.227976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.238871] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1236.695054] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.695462] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.695462] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.695767] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.696183] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.696293] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 57af03b0-8d4d-4f61-a384-800617af9be4 not found, creating... [ 1236.696583] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.696758] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.696886] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.697155] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.697306] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.700163] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.700386] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.700525] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.700768] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.700915] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.701089] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 57af03b0-8d4d-4f61-a384-800617af9be4 is going to be created. [ 1236.702229] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.722451] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.722685] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.722816] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.723113] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.723355] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.723619] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-57af03b0-8d4d-4f61-a384-800617af9be4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.912459] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401d776d-874d-46cf-ad91-06222d321584 in Status: SUCCESS [ 1236.912748] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.206027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.206027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.206027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.206027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.206027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.206027] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be created. [ 1237.230954] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.231117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.231448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.231448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.231565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.242263] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: UNINITIALIZED for 2s [ 1237.408088] env[62620]: INFO networking_nsxv3.common.synchronization [req-7adf3789-ecdb-4d6c-9a3a-650ca2f658c8 req-7e30f7b5-be26-4b08-8893-5a2bddb7ce9d service nova] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 1237.408088] env[62620]: INFO networking_nsxv3.common.synchronization [req-7adf3789-ecdb-4d6c-9a3a-650ca2f658c8 req-7e30f7b5-be26-4b08-8893-5a2bddb7ce9d service nova] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1237.408088] env[62620]: INFO networking_nsxv3.common.synchronization [req-7adf3789-ecdb-4d6c-9a3a-650ca2f658c8 req-7e30f7b5-be26-4b08-8893-5a2bddb7ce9d service nova] Enqueued Resource ID: 57af03b0-8d4d-4f61-a384-800617af9be4 with Priority: HIGHEST for action port [ 1237.408088] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 1237.408088] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1237.408717] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57af03b0-8d4d-4f61-a384-800617af9be4 with Priority: HIGHEST for action port [ 1237.409178] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.409563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.409736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.412017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.412017] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.412017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.412017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.412017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-57af03b0-8d4d-4f61-a384-800617af9be4 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.412017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57af03b0-8d4d-4f61-a384-800617af9be4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.412017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57af03b0-8d4d-4f61-a384-800617af9be4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.412017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57af03b0-8d4d-4f61-a384-800617af9be4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.412017] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57af03b0-8d4d-4f61-a384-800617af9be4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.913607] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.913954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.916260] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57af03b0-8d4d-4f61-a384-800617af9be4 with status ACTIVE [ 1237.916481] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.916610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.916680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.916900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.916993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.917209] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.917418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.917576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.917777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.917866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.918117] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.918227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.918292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.918444] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.918508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.919605] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57af03b0-8d4d-4f61-a384-800617af9be4 is going to be updated. [ 1237.940287] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.940519] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.940641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.940915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.941295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.941380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57af03b0-8d4d-4f61-a384-800617af9be4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.180116] env[62620]: INFO networking_nsxv3.common.synchronization [req-ec10b454-e2d5-4fd9-a471-113226bcd8b9 req-face7b8c-287e-4558-8a6c-aafcd6ee1ca0 tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1238.180662] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1238.181241] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.181382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.181451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.181656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.181817] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.181918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.181980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.182153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.182237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.182354] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.250198] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1238.250367] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 deletion is rescheduled due to dependency. [ 1238.250483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.250635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.250856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.251055] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.251198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.251287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.251457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.251535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.251627] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.627969] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.628583] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.628583] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.628726] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.629034] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.629286] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.629431] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.629671] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.629832] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.630063] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1238.630189] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1238.630305] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1238.630418] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1238.630532] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1238.630659] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1238.630779] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1238.647989] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1238.648203] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1238.648354] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1238.648544] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-765" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.648931] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.649078] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.649219] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.649549] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.649691] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bdf50e-6e1b-46c8-ae6a-26874ecb62a9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.684764] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.684892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.684955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.685205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.685299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.685499] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.685597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.685660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.685809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.685885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.685990] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1238.709904] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.710134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.710256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.710451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.710608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.717872] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1238.753355] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.151448] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.151761] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.151814] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.152179] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.152358] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.152526] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 20bdf50e-6e1b-46c8-ae6a-26874ecb62a9 not found, creating... [ 1239.152795] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.152958] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.153868] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.153868] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.153868] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.153868] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.153868] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.154161] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.154216] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.154359] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.154507] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 20bdf50e-6e1b-46c8-ae6a-26874ecb62a9 is going to be created. [ 1239.179552] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.180258] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.180258] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.180258] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.180533] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.180833] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.251925] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1239.253131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.253131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.253283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.253401] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.253521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.253586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.253749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.253828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.253914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.254011] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.254969] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.760027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.760027] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1239.760027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.760027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.760027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.761012] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.761012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.761012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.761012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.761012] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.761012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.761012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.761012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.761012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.761012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.761012] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.800029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.800197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.800296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.800553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.800786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.811962] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1239.931379] env[62620]: INFO networking_nsxv3.common.synchronization [req-ec10b454-e2d5-4fd9-a471-113226bcd8b9 req-7677e9f3-0472-4f6f-9d45-d6e114267501 service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1239.931585] env[62620]: INFO networking_nsxv3.common.synchronization [req-ec10b454-e2d5-4fd9-a471-113226bcd8b9 req-7677e9f3-0472-4f6f-9d45-d6e114267501 service nova] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1239.931730] env[62620]: INFO networking_nsxv3.common.synchronization [req-ec10b454-e2d5-4fd9-a471-113226bcd8b9 req-7677e9f3-0472-4f6f-9d45-d6e114267501 service nova] Enqueued Resource ID: 20bdf50e-6e1b-46c8-ae6a-26874ecb62a9 with Priority: HIGHEST for action port [ 1239.932276] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_rules [ 1239.932415] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1239.932514] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20bdf50e-6e1b-46c8-ae6a-26874ecb62a9 with Priority: HIGHEST for action port [ 1239.932788] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.932906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.932973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.934146] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.934238] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.935471] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.936095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.936289] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.936397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.936547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.936701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.936779] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bdf50e-6e1b-46c8-ae6a-26874ecb62a9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.264238] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20f5a061-dbd0-44d6-953b-0f455ddef899: rpc.has_security_group_logging(os_id): False [ 1240.282794] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.282997] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.283329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.283374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.283443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.283645] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.283747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.283835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.283960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.284057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.284255] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.284356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.284594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.284594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.284690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.284805] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.284894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.285080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.285116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.285174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.285256] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be created. [ 1240.341870] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.342092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.342212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.342618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.342853] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.355960] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1240.439724] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.439854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.440792] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20bdf50e-6e1b-46c8-ae6a-26874ecb62a9 with status ACTIVE [ 1240.440792] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.440792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.440792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.440792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.440792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.440792] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.441202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.441202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.441202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.441292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.441456] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.441556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.441619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.441763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.441830] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.441917] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20bdf50e-6e1b-46c8-ae6a-26874ecb62a9 is going to be updated. [ 1240.462564] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.462721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.462763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.462962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.463132] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.463309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20bdf50e-6e1b-46c8-ae6a-26874ecb62a9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.727250] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1240.727469] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c deletion is rescheduled due to dependency. [ 1240.727597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.727795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.728131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.728340] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.728462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.728530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.728690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.728773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.728866] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.231810] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.734901] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.769451] env[62620]: INFO networking_nsxv3.common.synchronization [req-420e6c21-51cc-4f44-a5ae-47375100075f req-4146b4c9-65dc-4658-9cf8-41cfb616d169 tempest-FloatingIPsAssociationNegativeTestJSON-1740626313 tempest-FloatingIPsAssociationNegativeTestJSON-1740626313-project-member] Enqueued Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGHEST for action security_group_members [ 1241.769973] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGHEST for action security_group_members [ 1241.770305] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-522dbe7d-0c4e-456f-9be7-2144d27ebc47 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.771032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1241.771032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.771032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1241.771032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.771032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1241.771032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.771305] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1241.771305] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1241.775018] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522dbe7d-0c4e-456f-9be7-2144d27ebc47',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.821422] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1241.821593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1241.822064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.822292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1241.822505] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.822626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1241.822692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.822849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1241.822930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1241.823022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1241.823113] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.237257] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.237411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.237486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.237708] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.237802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.237907] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1242.253905] env[62620]: INFO networking_nsxv3.common.synchronization [req-fce709e6-4a83-4427-b1fc-f67db27d6a15 req-7b68e28c-3d76-4014-a823-23a500b42cba tempest-ServerPasswordTestJSON-887539007 tempest-ServerPasswordTestJSON-887539007-project-member] Enqueued Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGHEST for action security_group_members [ 1242.254496] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGHEST for action security_group_members [ 1242.254838] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-401d776d-874d-46cf-ad91-06222d321584 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.254962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.255051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.255239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.255392] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.255486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.255547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.255691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.255770] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.255857] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401d776d-874d-46cf-ad91-06222d321584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.267486] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.267601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.267702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.267854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.268248] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.276597] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.276804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.276804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.276870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.278111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.278111] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.278111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.278111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.278111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.278111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.278111] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 is going to be updated. [ 1242.279732] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1242.303343] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.303479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.303576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.303757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.303897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.311037] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 in Status: IN_PROGRESS for 2s [ 1242.326223] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.370027] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1242.370115] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.758201] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.758525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.758525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.758679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.758769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.758967] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.759101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.759168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.759319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.759396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.759483] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401d776d-874d-46cf-ad91-06222d321584 is going to be updated. [ 1242.793136] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.793448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.793525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.793728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.793866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.802992] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401d776d-874d-46cf-ad91-06222d321584 in Status: IN_PROGRESS for 2s [ 1242.828533] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1536c72e-7b4e-46f0-a419-8f3b5002e371: rpc.has_security_group_logging(os_id): False [ 1242.847166] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.847166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.847166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.847438] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.847493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.847727] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.847826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.847888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.848112] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.848207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.848285] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1242.931743] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.931743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.931916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.932124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.932291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.945448] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1244.289766] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1244.290220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.290337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.290724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.290987] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.291202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.291292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.291574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.291693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.291771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.291910] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.320061] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 in Status: SUCCESS [ 1244.320373] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 deletion is rescheduled due to dependency. [ 1244.320620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.795116] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.795316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.795360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.795577] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.796488] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.796617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.796692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.796872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.796964] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.797074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.797264] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.797375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.797440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.797592] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.797733] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.797826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.797887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.798100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.798200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.798266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.798443] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.822730] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401d776d-874d-46cf-ad91-06222d321584 in Status: SUCCESS [ 1244.822924] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401d776d-874d-46cf-ad91-06222d321584 deletion is rescheduled due to dependency. [ 1244.823025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.960018] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1244.960272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.302405] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5026804-13b5-4b49-b1b4-b00084a12c8c: rpc.has_security_group_logging(os_id): False [ 1245.317991] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.318227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.318303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.318495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.318591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.318915] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.318915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.319024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.319106] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.319179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.319371] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.319458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.319525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.319667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.319740] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.319928] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.320530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.320530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.320530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.320530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.320530] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1245.376233] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.376532] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.376659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.377076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.377267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.399133] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1245.945167] env[62620]: INFO networking_nsxv3.common.synchronization [req-82ca3303-f204-418f-9e8f-3588ac130f28 req-a30515ba-0bca-452b-b4ea-274bf7730592 tempest-ServersNegativeTestJSON-470999703 tempest-ServersNegativeTestJSON-470999703-project-member] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1245.946528] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGHEST for action security_group_members [ 1245.946627] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.946753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.946822] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.947049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.947213] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.947314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.947376] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.947528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.947611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.947700] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.454120] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.454120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.454120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.454120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.454120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.454120] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.454120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.454120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.454120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.454120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.454120] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be updated. [ 1246.484031] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.484251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.484342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.484662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.484891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.495512] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: IN_PROGRESS for 2s [ 1247.031511] env[62620]: INFO networking_nsxv3.common.synchronization [req-54eb72c2-36b9-4769-acd6-7009de254d0c req-03ac60f8-df18-4a1f-91b6-5ac6b9a07e29 tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_members [ 1247.033032] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGHEST for action security_group_members [ 1247.033591] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.034257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.034257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.034257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.034483] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.034673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.034772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.034979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.035167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.035315] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.417768] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1247.417955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.539211] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.539211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.539529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.539529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.539583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.539780] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.539880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.539914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.540075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.540154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.540240] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a is going to be updated. [ 1247.571174] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.571174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.571174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.571174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.571174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.581642] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a in Status: IN_PROGRESS for 2s [ 1248.302037] env[62620]: INFO networking_nsxv3.common.synchronization [req-97ea74a8-b7d5-4b57-9ac3-87770aada023 req-b521109d-9feb-451f-ac8b-da170d780493 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_members [ 1248.302037] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGHEST for action security_group_members [ 1248.302037] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84080db-2e0a-4513-addc-aca7401b2740 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.302037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.302037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.302037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.302037] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.302037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.302037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.302037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.302037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.302037] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.507679] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 in Status: SUCCESS [ 1248.507864] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 deletion is rescheduled due to dependency. [ 1248.507979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.804442] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.805017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.805017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.805200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.805445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.805644] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.806549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.806549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.806549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.806549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.806549] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84080db-2e0a-4513-addc-aca7401b2740 is going to be updated. [ 1248.837200] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.837353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.837428] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.837642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.837904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.853079] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84080db-2e0a-4513-addc-aca7401b2740 in Status: IN_PROGRESS for 2s [ 1249.590451] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a in Status: SUCCESS [ 1249.590669] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a deletion is rescheduled due to dependency. [ 1249.590922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.642557] env[62620]: INFO networking_nsxv3.common.synchronization [None req-5d6e7f7a-f1fa-412a-8e8a-e23e58155932 None None] Enqueued Resource ID: c69b57ba-c06d-4687-8965-01feee45a202 with Priority: HIGHEST for action port [ 1250.642918] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69b57ba-c06d-4687-8965-01feee45a202 with Priority: HIGHEST for action port [ 1250.643342] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-c69b57ba-c06d-4687-8965-01feee45a202 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.643456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c69b57ba-c06d-4687-8965-01feee45a202" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.643527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c69b57ba-c06d-4687-8965-01feee45a202" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.643831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c69b57ba-c06d-4687-8965-01feee45a202" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.643919] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69b57ba-c06d-4687-8965-01feee45a202',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.863155] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84080db-2e0a-4513-addc-aca7401b2740 in Status: SUCCESS [ 1250.863155] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84080db-2e0a-4513-addc-aca7401b2740 deletion is rescheduled due to dependency. [ 1250.863155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.145671] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c69b57ba-c06d-4687-8965-01feee45a202 [ 1251.145914] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.146068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.146153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.146393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.146486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.146588] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c69b57ba-c06d-4687-8965-01feee45a202 already deleted. [ 1251.146671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c69b57ba-c06d-4687-8965-01feee45a202" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.353100] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.353324] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.353455] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.353750] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.355485] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.355763] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.355904] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.356220] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.356397] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.356647] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.356773] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.356893] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.357031] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.357213] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.357485] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.357649] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.376841] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.377313] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1251.377313] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.377506] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-108" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.377714] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-1034439a-d24f-4eb6-8139-67b012254146 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.377896] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.378066] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.378435] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.378575] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1034439a-d24f-4eb6-8139-67b012254146',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.887393] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.887831] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.887831] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.888746] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.888746] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.888746] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.888746] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.888992] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.889139] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.889355] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.889689] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.889821] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.889944] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.890334] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.890334] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.890474] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 1034439a-d24f-4eb6-8139-67b012254146 is going to be updated. [ 1251.912609] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.913207] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.913207] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.913480] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.913728] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.914048] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1252.650905] env[62620]: INFO networking_nsxv3.common.synchronization [req-4bb9e2e3-f9b6-4535-aff7-0965e5b576c8 req-016d579d-f078-4325-8100-1a41e6fab643 service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 1252.651196] env[62620]: INFO networking_nsxv3.common.synchronization [req-4bb9e2e3-f9b6-4535-aff7-0965e5b576c8 req-016d579d-f078-4325-8100-1a41e6fab643 service nova] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1252.651417] env[62620]: INFO networking_nsxv3.common.synchronization [req-4bb9e2e3-f9b6-4535-aff7-0965e5b576c8 req-016d579d-f078-4325-8100-1a41e6fab643 service nova] Enqueued Resource ID: 1034439a-d24f-4eb6-8139-67b012254146 with Priority: HIGHEST for action port [ 1252.652170] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_rules [ 1252.652356] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1252.652551] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1034439a-d24f-4eb6-8139-67b012254146 with Priority: HIGHEST for action port [ 1252.653067] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.653067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.653211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.653529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.653529] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.654690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.654865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.654958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.655192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.655400] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.655529] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.655617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.655813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.656188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1252.656188] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.656977] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-1034439a-d24f-4eb6-8139-67b012254146 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.657127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.657216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.657420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.657522] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1034439a-d24f-4eb6-8139-67b012254146',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.888346] env[62620]: INFO networking_nsxv3.common.synchronization [None req-3213ae75-4c11-4fcd-9ac6-9f7a6cd64284 None None] Enqueued Resource ID: 2f5dadfa-3a65-4c98-a396-1b324f81b12f with Priority: HIGHEST for action port [ 1252.888987] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5dadfa-3a65-4c98-a396-1b324f81b12f with Priority: HIGHEST for action port [ 1252.889358] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f5dadfa-3a65-4c98-a396-1b324f81b12f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.889494] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f5dadfa-3a65-4c98-a396-1b324f81b12f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.889654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f5dadfa-3a65-4c98-a396-1b324f81b12f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.889898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f5dadfa-3a65-4c98-a396-1b324f81b12f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.889999] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5dadfa-3a65-4c98-a396-1b324f81b12f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.160154] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.160154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.160326] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.161344] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1034439a-d24f-4eb6-8139-67b012254146 with status ACTIVE [ 1253.161429] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.161533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.161600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.162542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.162542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.162542] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.162542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.162542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.162542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.162542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.163057] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.163057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.163057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.163057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.163057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.163057] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1034439a-d24f-4eb6-8139-67b012254146 is going to be updated. [ 1253.183787] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.183787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.183787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.183787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.183787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.183787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1034439a-d24f-4eb6-8139-67b012254146" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.392288] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f5dadfa-3a65-4c98-a396-1b324f81b12f [ 1253.392575] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.392761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.392850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.393123] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.393251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.393369] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f5dadfa-3a65-4c98-a396-1b324f81b12f already deleted. [ 1253.393458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f5dadfa-3a65-4c98-a396-1b324f81b12f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.665685] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.167711] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.168037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1254.168037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.168815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1254.168815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1254.168815] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be updated. [ 1254.204707] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.204871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1254.204930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.205165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1254.205317] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1254.214237] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1254.538559] env[62620]: INFO networking_nsxv3.common.synchronization [req-b4d9d3d4-f83c-4b6e-a956-29a7b3b73f6d req-e96d0188-3fbe-4310-9f8c-c3520de67306 tempest-ServerDiskConfigTestJSON-1565889928 tempest-ServerDiskConfigTestJSON-1565889928-project-member] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1254.539273] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGHEST for action security_group_members [ 1254.539882] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.539882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1254.539882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.539882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1254.540053] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.540053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1254.540125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.540274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1254.540388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1254.540564] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.043231] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.043231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.043453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.043506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.043653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.043784] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.043884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.043953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.044150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.044204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.044282] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be updated. [ 1255.072948] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.073264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.073466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.073854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.074168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.083388] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: IN_PROGRESS for 2s [ 1256.226049] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1256.226049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.226049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.226528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.226528] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.226528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1256.226528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.226684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.226753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.226841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.226931] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.732027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.732027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.732027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.732027] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.732027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1256.732687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.732687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.732687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.733175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.733446] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.952129] env[62620]: INFO networking_nsxv3.common.synchronization [req-06a8e58b-7051-4e98-8e62-a61d7bc86591 req-b262d176-e8d0-41b1-9a60-75bdbbdb1317 tempest-InstanceActionsNegativeTestJSON-1216622255 tempest-InstanceActionsNegativeTestJSON-1216622255-project-member] Enqueued Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGHEST for action security_group_members [ 1256.952129] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGHEST for action security_group_members [ 1256.952129] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-93458070-780f-4248-9141-95ce7704bf27 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.952129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1256.952129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.953160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.953540] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.953846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1256.954093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.956014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.956014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.956014] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93458070-780f-4248-9141-95ce7704bf27',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.093919] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5026804-13b5-4b49-b1b4-b00084a12c8c in Status: SUCCESS [ 1257.093919] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c deletion is rescheduled due to dependency. [ 1257.093919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.236989] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20f5a061-dbd0-44d6-953b-0f455ddef899: rpc.has_security_group_logging(os_id): False [ 1257.254160] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.254288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.254329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.255080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.255080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.255080] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.255247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.255247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.255445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.255541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.255754] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.255892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.255975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.256166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.256286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.256505] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.256629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.256709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.256912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.256961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.257108] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be updated. [ 1257.275758] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-954 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.275956] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-954" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.276101] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-954" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.276416] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-954" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.277117] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.277300] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.277455] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.277656] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.277805] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.278025] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.278151] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1257.278295] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1257.278415] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1257.278533] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.278647] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1257.278794] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1257.295817] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1257.295982] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1257.296149] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1257.296329] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-954" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.296618] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.296788] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.296915] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.297230] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.297536] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.316837] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.316980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.317066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.317261] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.317406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.333478] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1257.457113] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.457281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.457347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.457580] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.457667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.457889] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.458048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.458048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.458275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.458329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.458419] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93458070-780f-4248-9141-95ce7704bf27 already deleted. [ 1257.458502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.801089] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.801089] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.801089] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.801089] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.801344] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.801344] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8 not found, creating... [ 1257.801560] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.801722] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.801849] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.802093] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.802246] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.802535] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.802698] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.802823] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.803056] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.803250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.803429] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8 is going to be created. [ 1257.824732] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.824912] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1257.825061] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.825298] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1257.825551] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.825771] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1258.565339] env[62620]: INFO networking_nsxv3.common.synchronization [req-06a8e58b-7051-4e98-8e62-a61d7bc86591 req-18ff5b8c-16aa-4382-a57c-f261e49a2d5d service nova] Enqueued Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGHEST for action security_group_rules [ 1258.565339] env[62620]: INFO networking_nsxv3.common.synchronization [req-06a8e58b-7051-4e98-8e62-a61d7bc86591 req-18ff5b8c-16aa-4382-a57c-f261e49a2d5d service nova] Enqueued Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGHEST for action security_group_members [ 1258.565339] env[62620]: INFO networking_nsxv3.common.synchronization [req-06a8e58b-7051-4e98-8e62-a61d7bc86591 req-18ff5b8c-16aa-4382-a57c-f261e49a2d5d service nova] Enqueued Resource ID: 8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8 with Priority: HIGHEST for action port [ 1258.565686] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGHEST for action security_group_rules [ 1258.565686] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGHEST for action security_group_members [ 1258.565686] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8 with Priority: HIGHEST for action port [ 1258.565921] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93458070-780f-4248-9141-95ce7704bf27 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.566257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1258.566369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.566642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1258.566750] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93458070-780f-4248-9141-95ce7704bf27',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.567588] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-93458070-780f-4248-9141-95ce7704bf27 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.567728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1258.567816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.568013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1258.568683] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.568842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1258.568937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.569138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1258.569307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1258.569430] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93458070-780f-4248-9141-95ce7704bf27',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.570221] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.570396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1258.570459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.570644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1258.570743] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.072409] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93458070-780f-4248-9141-95ce7704bf27',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.073484] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-93458070-780f-4248-9141-95ce7704bf27 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.073647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1259.073747] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8 with status ACTIVE [ 1259.073905] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.074020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1259.074092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.074296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1259.074383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1259.074557] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.074662] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1259.074725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.074852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1259.074964] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1259.075117] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.075343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1259.075390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.075542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1259.075616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1259.075701] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8 is going to be updated. [ 1259.094581] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.094721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1259.094757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.094918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1259.095062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1259.095209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8875fdf7-7fa0-4e9d-bfe4-be006d9c72f8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1259.348654] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1259.348869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1259.578236] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93458070-780f-4248-9141-95ce7704bf27',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.028859] env[62620]: INFO networking_nsxv3.common.synchronization [req-e25e24c9-555b-4402-927b-d13072c83244 req-274cf309-d1e3-446a-82e0-85fc9d8bec3d tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1260.029445] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1260.029750] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.029875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.029937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.030199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.030358] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.030454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.030548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.030663] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.030747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.030838] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.080474] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.080692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.080692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.080902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.080991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.081106] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93458070-780f-4248-9141-95ce7704bf27 is going to be created. [ 1260.103492] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.103681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.103721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.103951] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.104137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.113111] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93458070-780f-4248-9141-95ce7704bf27 in Status: UNINITIALIZED for 2s [ 1260.347302] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.347506] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.347639] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.347921] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.348208] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.348398] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.348525] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.348749] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.348902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.349129] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1260.349279] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1260.349412] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1260.349526] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1260.349671] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1260.349797] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1260.349939] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1260.367477] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1260.367642] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1260.367786] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1260.367968] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.368345] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-2cabec54-95a1-48db-b0ba-596ee7f4671e taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.368531] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.368665] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.368960] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.369138] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cabec54-95a1-48db-b0ba-596ee7f4671e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.532746] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.532900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.532976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.533228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.533324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.533529] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.533674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.533725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.533875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.533954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.534054] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3921e17-5705-42fe-988b-f0c37340437f is going to be deleted. [ 1260.562575] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.562734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.562806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.563014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.563111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.563209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.872339] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.872339] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.872339] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.872672] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.872764] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.873073] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 2cabec54-95a1-48db-b0ba-596ee7f4671e not found, creating... [ 1260.873457] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.875411] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.875411] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.875411] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.875411] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.875411] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.875411] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.875411] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.875411] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.875411] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.875411] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 2cabec54-95a1-48db-b0ba-596ee7f4671e is going to be created. [ 1260.895341] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.895610] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.895750] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.896048] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.896320] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.896563] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.928269] env[62620]: INFO networking_nsxv3.common.synchronization [req-efc5541c-c6c9-4037-9dd6-bf4918ed5b44 req-f33ac986-6704-4e23-ac7d-0f8112edb2ef tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_members [ 1260.928805] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGHEST for action security_group_members [ 1260.929140] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.929313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.929375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.929535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.929695] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.929796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.929860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.930800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.930989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.931158] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.434037] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.434323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.434402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.434619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.434710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1261.434908] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.435016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.435080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.435228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.435303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1261.435391] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 is going to be updated. [ 1261.461257] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.461328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.461404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.461620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.462123] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1261.470198] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 in Status: IN_PROGRESS for 2s [ 1261.594349] env[62620]: INFO networking_nsxv3.common.synchronization [req-e25e24c9-555b-4402-927b-d13072c83244 req-d735a796-9ebd-45e8-b85b-a495e7f2399c service nova] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_rules [ 1261.594349] env[62620]: INFO networking_nsxv3.common.synchronization [req-e25e24c9-555b-4402-927b-d13072c83244 req-d735a796-9ebd-45e8-b85b-a495e7f2399c service nova] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1261.594349] env[62620]: INFO networking_nsxv3.common.synchronization [req-e25e24c9-555b-4402-927b-d13072c83244 req-d735a796-9ebd-45e8-b85b-a495e7f2399c service nova] Enqueued Resource ID: 2cabec54-95a1-48db-b0ba-596ee7f4671e with Priority: HIGHEST for action port [ 1261.594349] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_rules [ 1261.594349] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1261.594622] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cabec54-95a1-48db-b0ba-596ee7f4671e with Priority: HIGHEST for action port [ 1261.594769] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.594910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.594910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.595354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.595434] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.597029] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.597029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.597257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.597289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.597426] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.598021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.598021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.598021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.598021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1261.598230] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.601296] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cabec54-95a1-48db-b0ba-596ee7f4671e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.601296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.601296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.601296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.601296] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cabec54-95a1-48db-b0ba-596ee7f4671e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.097754] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.098064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.104025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.104025] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cabec54-95a1-48db-b0ba-596ee7f4671e with status ACTIVE [ 1262.104025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.104233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.104233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.104481] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.104570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.104760] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.104919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.104991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.105193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.105272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.105480] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.105574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.105634] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.105774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.105848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.106174] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cabec54-95a1-48db-b0ba-596ee7f4671e is going to be updated. [ 1262.121657] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93458070-780f-4248-9141-95ce7704bf27 in Status: SUCCESS [ 1262.121892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.122254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.122458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.122603] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.122716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.122779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.122920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.122994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.123121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.123175] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93458070-780f-4248-9141-95ce7704bf27',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.127111] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.127225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.127900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.127900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.127900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.127900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.608726] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.624823] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-93458070-780f-4248-9141-95ce7704bf27 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.624987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.625037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.625250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.625498] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.625498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.625661] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.625794] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.625877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.625959] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.626118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-93458070-780f-4248-9141-95ce7704bf27 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.626205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.626286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.626433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.626566] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.626650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1262.626706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.626836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1262.626908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.626987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1262.627078] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93458070-780f-4248-9141-95ce7704bf27',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.114395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.114637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1263.114637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.114728] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.114817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.114925] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3921e17-5705-42fe-988b-f0c37340437f is going to be created. [ 1263.132997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93458070-780f-4248-9141-95ce7704bf27: rpc.has_security_group_logging(os_id): False [ 1263.214023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.214023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1263.214023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.214023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.214023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.220498] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: UNINITIALIZED for 2s [ 1263.229017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.229017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1263.229017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.229017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.229227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.229372] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.229500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1263.229579] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.229793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.229881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.230412] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.230412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1263.230596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.230772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.230873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.231668] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.231668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1263.231668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.231668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.231668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.231668] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93458070-780f-4248-9141-95ce7704bf27 is going to be created. [ 1263.317503] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.317960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1263.317960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.317960] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.318534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.331505] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93458070-780f-4248-9141-95ce7704bf27 in Status: IN_PROGRESS for 2s [ 1263.479235] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 in Status: SUCCESS [ 1263.479478] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 deletion is rescheduled due to dependency. [ 1263.479612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.230061] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: SUCCESS [ 1265.230423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.230423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.230564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.230763] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.230881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.230950] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.231126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.231211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.231300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.231417] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.344275] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93458070-780f-4248-9141-95ce7704bf27 in Status: SUCCESS [ 1265.344517] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.698321] env[62620]: INFO networking_nsxv3.common.synchronization [None req-422e81ef-c5ec-4e7b-ba43-84765e6edb25 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_rules [ 1265.698321] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_rules [ 1265.699106] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09255348-01e0-470e-b2fe-9b59aa2a53dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.699409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.699623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.699979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.700171] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.734599] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.734599] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.734880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.734917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.736133] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.736133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.736133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.736133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.736133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.736133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.736133] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.736133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.736133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.736133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.736665] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.736665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.736665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.736665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.736665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.736831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.736831] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.784399] env[62620]: INFO networking_nsxv3.common.synchronization [None req-dbd67cfd-8aca-4661-bc21-9c411b75bd59 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_rules [ 1265.784852] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_rules [ 1265.785225] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09255348-01e0-470e-b2fe-9b59aa2a53dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.785345] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1266.219325] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.219530] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1266.219574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.219774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1266.219863] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1266.219957] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd already deleted. [ 1266.220057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1266.220200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.220350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1266.220435] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.240115] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3921e17-5705-42fe-988b-f0c37340437f: rpc.has_security_group_logging(os_id): False [ 1266.257944] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.258134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1266.258230] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.258491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1266.258588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1266.258853] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.258987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1266.259263] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.259486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1266.259602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1266.259810] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.259945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1266.260342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.260558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1266.260670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1266.261201] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.261201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1266.261201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.261201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1266.261398] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1266.261432] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3921e17-5705-42fe-988b-f0c37340437f is going to be created. [ 1266.317264] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.317425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1266.317505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.317789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1266.317946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1266.331657] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: IN_PROGRESS for 2s [ 1266.749377] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.749531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1266.749585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.749804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1266.749899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1266.749997] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd already deleted. [ 1266.750093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.033973] env[62620]: INFO networking_nsxv3.common.synchronization [req-8297deaa-8799-47ac-8265-2d0a53d43d76 req-d6719c1b-3b07-407b-a6ce-70c8802ff4ed tempest-InstanceActionsNegativeTestJSON-1216622255 tempest-InstanceActionsNegativeTestJSON-1216622255-project-member] Enqueued Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGHEST for action security_group_members [ 1268.035213] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGHEST for action security_group_members [ 1268.035213] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-93458070-780f-4248-9141-95ce7704bf27 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.035389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.035389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.035546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.035713] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.035846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.035846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.036012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.036096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.036170] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93458070-780f-4248-9141-95ce7704bf27',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.307255] env[62620]: INFO networking_nsxv3.common.synchronization [req-18aec2fb-1c67-4d5b-b824-9ec0bae4fc1d req-3e818458-d7f5-43db-a2f1-9da92b7368ce tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1268.307775] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1268.308088] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.308680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.308680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.308680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.308680] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.308942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.308942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.309029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.309071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.309216] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.345934] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: SUCCESS [ 1268.345934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.538199] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.538406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.538483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.538717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.538813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.539031] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.539134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.539198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.539372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.539455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.539548] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93458070-780f-4248-9141-95ce7704bf27 is going to be updated. [ 1268.567949] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.568108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.568180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.568470] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.568619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.577731] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93458070-780f-4248-9141-95ce7704bf27 in Status: IN_PROGRESS for 2s [ 1268.811460] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.313987] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.817276] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.817433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.817473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.817659] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.817746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.817850] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 is going to be updated. [ 1269.860541] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.860691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.860730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.860941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.861102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.869491] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: IN_PROGRESS for 2s [ 1269.985609] env[62620]: INFO networking_nsxv3.common.synchronization [req-60e9ff9d-0a0f-4c3d-8863-ada24731f4da req-3643801b-961a-400a-80e5-614f61c7a3c7 tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1269.986223] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGHEST for action security_group_members [ 1269.986523] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.986655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.986723] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.986927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.987096] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.987199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.987266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.987416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.987504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.987598] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.028657] env[62620]: INFO networking_nsxv3.common.synchronization [req-60e9ff9d-0a0f-4c3d-8863-ada24731f4da req-3643801b-961a-400a-80e5-614f61c7a3c7 tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 2cabec54-95a1-48db-b0ba-596ee7f4671e with Priority: HIGHEST for action port [ 1270.029154] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cabec54-95a1-48db-b0ba-596ee7f4671e with Priority: HIGHEST for action port [ 1270.029525] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cabec54-95a1-48db-b0ba-596ee7f4671e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.029701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.029733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.029907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.029992] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cabec54-95a1-48db-b0ba-596ee7f4671e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.489853] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.490171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.490171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.490301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.490385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1270.490581] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.490705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.490760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.491073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.491073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1270.491073] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3921e17-5705-42fe-988b-f0c37340437f is going to be updated. [ 1270.524243] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.524391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.524471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.524690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.524835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1270.532535] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cabec54-95a1-48db-b0ba-596ee7f4671e with status ACTIVE [ 1270.532535] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.532535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.532535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.532535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.532535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1270.532535] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.532535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.532535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.532889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.532889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1270.532889] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.532979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.532979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.533279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.533387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1270.533788] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cabec54-95a1-48db-b0ba-596ee7f4671e is going to be updated. [ 1270.535286] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: IN_PROGRESS for 2s [ 1270.553920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.554076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.554171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.554339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.554469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1270.554616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cabec54-95a1-48db-b0ba-596ee7f4671e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1270.588395] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93458070-780f-4248-9141-95ce7704bf27 in Status: SUCCESS [ 1270.588578] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93458070-780f-4248-9141-95ce7704bf27 deletion is rescheduled due to dependency. [ 1270.588688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1271.347656] env[62620]: INFO networking_nsxv3.common.synchronization [req-763188f1-bd04-4312-b50d-3e4d137a7141 req-34e69abe-813e-44c1-93c5-50f10596cd1f tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_members [ 1271.348200] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_members [ 1271.348570] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-09255348-01e0-470e-b2fe-9b59aa2a53dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.348689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1271.348758] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.349011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1271.349166] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.349267] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1271.349375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.349546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1271.349630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1271.349725] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.611859] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.612189] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1271.612228] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.612485] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1271.612752] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.612919] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1271.613059] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.613279] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1271.613436] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1271.613688] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.613813] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.613933] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.614062] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.614183] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.614298] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.614441] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.632554] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.632743] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1271.632892] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.633109] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1271.633451] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-f766cde0-2056-4245-861e-695b52bcc3b2 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.633859] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-f766cde0-2056-4245-861e-695b52bcc3b2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1271.633859] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-f766cde0-2056-4245-861e-695b52bcc3b2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.634120] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-f766cde0-2056-4245-861e-695b52bcc3b2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1271.634276] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f766cde0-2056-4245-861e-695b52bcc3b2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.851365] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.851561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1271.851609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.851806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1271.851900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1271.852122] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.852226] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1271.852293] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.852446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1271.852524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1271.852609] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd already deleted. [ 1271.852690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1271.882603] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: SUCCESS [ 1271.882784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.136778] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.137040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.137181] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.137480] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.137645] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.137809] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port f766cde0-2056-4245-861e-695b52bcc3b2 not found, creating... [ 1272.138098] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.138269] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.138489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.138795] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.138951] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.139256] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.139477] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.139625] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.139845] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.139990] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.140153] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: f766cde0-2056-4245-861e-695b52bcc3b2 is going to be created. [ 1272.159357] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.159571] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.159706] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.159979] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.160248] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.160476] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-f766cde0-2056-4245-861e-695b52bcc3b2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.544084] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3921e17-5705-42fe-988b-f0c37340437f in Status: SUCCESS [ 1272.544274] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3921e17-5705-42fe-988b-f0c37340437f deletion is rescheduled due to dependency. [ 1272.544396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.859166] env[62620]: INFO networking_nsxv3.common.synchronization [req-763188f1-bd04-4312-b50d-3e4d137a7141 req-52fad8bb-d438-4892-8a01-50898d5f88ed service nova] Enqueued Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_rules [ 1272.859476] env[62620]: INFO networking_nsxv3.common.synchronization [req-763188f1-bd04-4312-b50d-3e4d137a7141 req-52fad8bb-d438-4892-8a01-50898d5f88ed service nova] Enqueued Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_members [ 1272.859580] env[62620]: INFO networking_nsxv3.common.synchronization [req-763188f1-bd04-4312-b50d-3e4d137a7141 req-52fad8bb-d438-4892-8a01-50898d5f88ed service nova] Enqueued Resource ID: f766cde0-2056-4245-861e-695b52bcc3b2 with Priority: HIGHEST for action port [ 1272.859870] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_rules [ 1272.860033] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_members [ 1272.860141] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f766cde0-2056-4245-861e-695b52bcc3b2 with Priority: HIGHEST for action port [ 1272.860724] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09255348-01e0-470e-b2fe-9b59aa2a53dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.860862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.860933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.861154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.861253] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.862881] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-09255348-01e0-470e-b2fe-9b59aa2a53dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.862881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.862881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.862881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.862881] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.862881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.862881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.862881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.862881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.863431] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.863652] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-f766cde0-2056-4245-861e-695b52bcc3b2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.863757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f766cde0-2056-4245-861e-695b52bcc3b2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.863822] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f766cde0-2056-4245-861e-695b52bcc3b2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.863968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f766cde0-2056-4245-861e-695b52bcc3b2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.864049] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f766cde0-2056-4245-861e-695b52bcc3b2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.366216] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.367628] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-09255348-01e0-470e-b2fe-9b59aa2a53dd taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.367758] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1273.367932] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f766cde0-2056-4245-861e-695b52bcc3b2 with status ACTIVE [ 1273.368273] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.368273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1273.368273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.368518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1273.368611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1273.368783] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.368881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1273.368939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.369130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1273.369414] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1273.369734] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.369823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1273.369898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.370075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1273.370160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1273.370248] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f766cde0-2056-4245-861e-695b52bcc3b2 is going to be updated. [ 1273.389121] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.389121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1273.389121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.389315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1273.389464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1273.389519] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f766cde0-2056-4245-861e-695b52bcc3b2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1273.872765] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.376826] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.377751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.377751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.377751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.377751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1274.377751] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd is going to be created. [ 1274.399654] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.399654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.399654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.399654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.399654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1274.409892] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd in Status: UNINITIALIZED for 2s [ 1276.420132] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd in Status: SUCCESS [ 1276.420535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.420535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.420727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.420916] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.421045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.421111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.421265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.421363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.421460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.421551] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.871856] env[62620]: INFO networking_nsxv3.common.synchronization [req-6702ff64-af57-49fb-9a9d-a0270db33b30 req-cff31333-f681-4acc-af1c-fe1134387684 tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1276.872405] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 with Priority: HIGHEST for action security_group_members [ 1276.872699] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f23bc15-3356-4a60-a94f-750f1fd18026 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.872828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.872896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.873123] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.873280] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.873486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.873486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.873633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.873664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.873751] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f23bc15-3356-4a60-a94f-750f1fd18026',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.925401] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.375841] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.376052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1277.376124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.376421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1277.376550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1277.376772] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.376880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1277.376941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.377121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1277.377214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1277.377305] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 is going to be updated. [ 1277.401013] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.401176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1277.401236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.401553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1277.401634] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1277.413692] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: IN_PROGRESS for 2s [ 1277.428057] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09255348-01e0-470e-b2fe-9b59aa2a53dd: rpc.has_security_group_logging(os_id): False [ 1277.448132] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.448335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1277.448374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.448669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1277.448784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1277.449103] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.449227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1277.449294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.449509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1277.449593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1277.449685] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd is going to be created. [ 1277.529425] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.529639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1277.529639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.530057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1277.530227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1277.545226] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd in Status: IN_PROGRESS for 2s [ 1277.640202] env[62620]: INFO networking_nsxv3.common.synchronization [None req-a2ab51ff-2bc8-4639-8be9-c3efb9d163ef None None] Enqueued Resource ID: db3621f6-b2ec-4591-afd2-79d5c845274e with Priority: HIGHEST for action port [ 1277.640889] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3621f6-b2ec-4591-afd2-79d5c845274e with Priority: HIGHEST for action port [ 1277.641162] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-db3621f6-b2ec-4591-afd2-79d5c845274e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.641341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db3621f6-b2ec-4591-afd2-79d5c845274e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1277.641393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db3621f6-b2ec-4591-afd2-79d5c845274e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.641661] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db3621f6-b2ec-4591-afd2-79d5c845274e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1277.641765] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db3621f6-b2ec-4591-afd2-79d5c845274e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.144155] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db3621f6-b2ec-4591-afd2-79d5c845274e [ 1278.144155] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.144369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1278.144369] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.144546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1278.144641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1278.144737] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db3621f6-b2ec-4591-afd2-79d5c845274e already deleted. [ 1278.144851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db3621f6-b2ec-4591-afd2-79d5c845274e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1279.422008] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 in Status: SUCCESS [ 1279.422338] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f23bc15-3356-4a60-a94f-750f1fd18026 deletion is rescheduled due to dependency. [ 1279.422338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f23bc15-3356-4a60-a94f-750f1fd18026" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1279.555593] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd in Status: SUCCESS [ 1279.556419] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1279.565026] env[62620]: INFO networking_nsxv3.common.synchronization [None req-159c7159-b23a-4da4-a258-2082d7361205 None None] Enqueued Resource ID: c7939a97-6359-4a13-a344-7e481d1252c8 with Priority: HIGHEST for action port [ 1279.565300] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7939a97-6359-4a13-a344-7e481d1252c8 with Priority: HIGHEST for action port [ 1279.566086] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7939a97-6359-4a13-a344-7e481d1252c8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.566086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7939a97-6359-4a13-a344-7e481d1252c8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1279.566251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7939a97-6359-4a13-a344-7e481d1252c8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.567211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7939a97-6359-4a13-a344-7e481d1252c8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1279.567211] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7939a97-6359-4a13-a344-7e481d1252c8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.068400] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7939a97-6359-4a13-a344-7e481d1252c8 [ 1280.068766] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.070009] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1280.070099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.070354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1280.070422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1280.070533] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7939a97-6359-4a13-a344-7e481d1252c8 already deleted. [ 1280.070618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7939a97-6359-4a13-a344-7e481d1252c8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1281.283447] env[62620]: INFO networking_nsxv3.common.synchronization [None req-fd52437a-6883-4c4b-9af8-88331dc196fd tempest-AttachInterfacesTestJSON-578257446 tempest-AttachInterfacesTestJSON-578257446-project-member] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1281.283995] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGHEST for action security_group_members [ 1281.284320] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.284445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1281.284520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.284721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1281.284880] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.284983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1281.285064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.285218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1281.285307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1281.285403] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.788063] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.788063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1281.788233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.788323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1281.788422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1281.788688] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.788792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1281.788858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.789024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1281.789105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1281.789194] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be updated. [ 1281.816151] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.816295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1281.816337] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.816527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1281.816665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1281.824711] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: IN_PROGRESS for 2s [ 1283.216135] env[62620]: INFO networking_nsxv3.common.synchronization [req-4e20259e-4a12-4b30-9a31-f564aabcb0c7 req-1308f68a-d462-4477-ad79-90f71f159335 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1283.219605] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1283.223017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.223017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.223017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.223017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.223017] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.223017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.223017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.223017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.223017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.223017] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.492100] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.492254] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.492254] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.492683] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.492994] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.493219] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.493380] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.493635] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.493956] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.494055] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1283.494226] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1283.494371] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1283.494515] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1283.494662] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1283.494788] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1283.494944] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1283.514851] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1283.515103] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1283.515303] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1283.515527] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.515891] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-d1a62857-50ae-4f10-8206-bfd58d9da6e0 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.516172] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-d1a62857-50ae-4f10-8206-bfd58d9da6e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.516372] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-d1a62857-50ae-4f10-8206-bfd58d9da6e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.516724] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-d1a62857-50ae-4f10-8206-bfd58d9da6e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.516908] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1a62857-50ae-4f10-8206-bfd58d9da6e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.723379] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.723547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.723624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.723850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.723941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.724171] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.724272] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.724334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.724487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.724565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.724747] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 already deleted. [ 1283.724842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.833770] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 in Status: SUCCESS [ 1283.833958] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 deletion is rescheduled due to dependency. [ 1283.834087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.019140] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.019391] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.019527] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.019826] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.019991] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.020168] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port d1a62857-50ae-4f10-8206-bfd58d9da6e0 not found, creating... [ 1284.020436] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.020671] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.020747] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.021016] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.021206] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.021561] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.021742] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.021869] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.022101] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.022251] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.022398] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: d1a62857-50ae-4f10-8206-bfd58d9da6e0 is going to be created. [ 1284.042696] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.042900] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.043053] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.043396] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.043676] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.043948] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-d1a62857-50ae-4f10-8206-bfd58d9da6e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.747241] env[62620]: INFO networking_nsxv3.common.synchronization [req-4e20259e-4a12-4b30-9a31-f564aabcb0c7 req-d4355e46-54fc-490a-8cd8-1dcc24118b92 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1284.747241] env[62620]: INFO networking_nsxv3.common.synchronization [req-4e20259e-4a12-4b30-9a31-f564aabcb0c7 req-d4355e46-54fc-490a-8cd8-1dcc24118b92 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1284.747241] env[62620]: INFO networking_nsxv3.common.synchronization [req-4e20259e-4a12-4b30-9a31-f564aabcb0c7 req-d4355e46-54fc-490a-8cd8-1dcc24118b92 service nova] Enqueued Resource ID: d1a62857-50ae-4f10-8206-bfd58d9da6e0 with Priority: HIGHEST for action port [ 1284.747241] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1284.747241] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1284.747241] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1a62857-50ae-4f10-8206-bfd58d9da6e0 with Priority: HIGHEST for action port [ 1284.747241] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.747241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.747241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.747241] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.748228] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.748806] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.748922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.748990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.749180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.749333] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.749432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.749503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.749652] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.752203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.752203] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.752203] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1a62857-50ae-4f10-8206-bfd58d9da6e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.752203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1a62857-50ae-4f10-8206-bfd58d9da6e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.752203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1a62857-50ae-4f10-8206-bfd58d9da6e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.752203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1a62857-50ae-4f10-8206-bfd58d9da6e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.752203] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1a62857-50ae-4f10-8206-bfd58d9da6e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.252422] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.253617] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.253729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1285.254165] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1a62857-50ae-4f10-8206-bfd58d9da6e0 with status ACTIVE [ 1285.254165] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.254299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1285.254299] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.254560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1285.254704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1285.254953] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.255104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1285.255182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.255373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1285.255550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1285.259359] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.259518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1285.259618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.259793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1285.259879] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1285.259973] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1a62857-50ae-4f10-8206-bfd58d9da6e0 is going to be updated. [ 1285.280333] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.280464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1285.280548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.280737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1285.280882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1285.281053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1a62857-50ae-4f10-8206-bfd58d9da6e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1285.762375] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.265032] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.265234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1286.265318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.265572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1286.265682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1286.265794] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be created. [ 1286.289799] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.289921] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1286.290012] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.290203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1286.290362] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1286.298570] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: UNINITIALIZED for 2s [ 1288.308707] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1288.309026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1288.309064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.309264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1288.309450] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.309608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1288.309699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.309878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1288.309965] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1288.310090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1288.310190] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.812923] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.813122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1288.813122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.813352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1288.813583] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.813795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1288.813795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.814010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1288.814090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1288.814153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1288.814304] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.814467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1288.814535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.814813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1288.814986] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.815124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1288.815187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.815375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1288.815477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1288.815587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1288.815687] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.317856] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea919c93-c5eb-459f-869f-c9c9eae06e59: rpc.has_security_group_logging(os_id): False [ 1289.336128] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.336284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.336284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.336474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.336583] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.336774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.336904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.336993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.337114] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.337185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.337382] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.337493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.337574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.337681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.337769] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.337968] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.338211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.338281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.338721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.338721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.338721] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be created. [ 1289.397936] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.398097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.398156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.398372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.398587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.408495] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1289.747375] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.747556] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1291.421098] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1291.421351] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.349373] env[62620]: INFO networking_nsxv3.common.synchronization [req-2398972c-85cc-43ae-8719-b841be9c55c9 req-6d6598b6-9b95-43f0-a1d9-be168abbd792 tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_members [ 1293.349373] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGHEST for action security_group_members [ 1293.349373] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.349373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.349373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.349373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.349373] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.349373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.349373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.349373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.349373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.350173] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.441091] env[62620]: INFO networking_nsxv3.common.synchronization [req-53fef0e2-adea-4e2c-b3a7-7724cdf467f0 req-4a18cf7f-4138-4d5d-8aa1-16406d9b3f0a tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 1293.443179] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 1293.443179] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.443179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.443179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.443179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.443375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.443834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.443834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.443933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.444086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.444261] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.852769] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.852941] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.853050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.853276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.853372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.853571] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.853677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.853753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.853906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.853983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.854086] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d is going to be updated. [ 1293.876312] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.876518] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.876651] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.876931] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.877214] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.877381] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.877506] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.877732] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.877898] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.878130] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.878377] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1293.878377] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1293.878473] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1293.878632] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.878755] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1293.878896] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1293.881198] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.881467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.881467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.881535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.881651] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.888438] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d in Status: IN_PROGRESS for 2s [ 1293.899085] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1293.899251] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1293.899397] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1293.899578] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-243" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.899897] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-213d4e79-8676-47f0-9e73-c3a36df750d1 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.900096] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-213d4e79-8676-47f0-9e73-c3a36df750d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.900227] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-213d4e79-8676-47f0-9e73-c3a36df750d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.900567] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-213d4e79-8676-47f0-9e73-c3a36df750d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.900661] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213d4e79-8676-47f0-9e73-c3a36df750d1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.946445] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.402644] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.403072] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1294.403189] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.403396] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1294.403583] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.403748] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 213d4e79-8676-47f0-9e73-c3a36df750d1 not found, creating... [ 1294.403980] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.404171] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1294.404299] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.404528] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1294.404674] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.404969] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.405164] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1294.405291] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.405509] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1294.405653] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.405825] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 213d4e79-8676-47f0-9e73-c3a36df750d1 is going to be created. [ 1294.431356] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.431565] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1294.431693] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.431995] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1294.432245] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.432484] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-213d4e79-8676-47f0-9e73-c3a36df750d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.449124] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.952178] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.952360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1294.952360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.952594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1294.952688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.952788] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 255ec5a6-942e-49be-b759-c091160337f6 is going to be updated. [ 1294.979046] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.979046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1294.979046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.979046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1294.979275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.989956] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: IN_PROGRESS for 2s [ 1295.150957] env[62620]: INFO networking_nsxv3.common.synchronization [req-53fef0e2-adea-4e2c-b3a7-7724cdf467f0 req-05464d86-7e26-4be4-8b3c-37a3e548203f service nova] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_rules [ 1295.151155] env[62620]: INFO networking_nsxv3.common.synchronization [req-53fef0e2-adea-4e2c-b3a7-7724cdf467f0 req-05464d86-7e26-4be4-8b3c-37a3e548203f service nova] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 1295.151302] env[62620]: INFO networking_nsxv3.common.synchronization [req-53fef0e2-adea-4e2c-b3a7-7724cdf467f0 req-05464d86-7e26-4be4-8b3c-37a3e548203f service nova] Enqueued Resource ID: 213d4e79-8676-47f0-9e73-c3a36df750d1 with Priority: HIGHEST for action port [ 1295.151530] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_rules [ 1295.151660] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 1295.151760] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 213d4e79-8676-47f0-9e73-c3a36df750d1 with Priority: HIGHEST for action port [ 1295.152387] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.152797] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1295.152875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.153512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1295.155455] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.155455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.155455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1295.155455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-213d4e79-8676-47f0-9e73-c3a36df750d1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.155773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-213d4e79-8676-47f0-9e73-c3a36df750d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1295.155773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-213d4e79-8676-47f0-9e73-c3a36df750d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.155827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-213d4e79-8676-47f0-9e73-c3a36df750d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1295.155896] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213d4e79-8676-47f0-9e73-c3a36df750d1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.658828] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.659195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1295.659195] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 213d4e79-8676-47f0-9e73-c3a36df750d1 with status ACTIVE [ 1295.659374] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.659502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1295.659550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.659810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1295.659904] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1295.660098] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.660197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1295.660260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.660418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1295.660495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1295.660672] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.660765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1295.660840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.660983] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1295.661071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1295.661163] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 213d4e79-8676-47f0-9e73-c3a36df750d1 is going to be updated. [ 1295.681621] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.681773] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1295.681816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.681995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1295.682141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1295.682287] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-213d4e79-8676-47f0-9e73-c3a36df750d1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1295.898107] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d in Status: SUCCESS [ 1295.898291] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d deletion is rescheduled due to dependency. [ 1295.898418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1296.998873] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: SUCCESS [ 1296.999273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1296.999273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.999471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1296.999716] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.999851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1296.999897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.000055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1297.000140] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1297.000233] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.502504] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.004502] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.507148] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.507304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1298.507380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.507613] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1298.507702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1298.507808] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 255ec5a6-942e-49be-b759-c091160337f6 is going to be updated. [ 1298.542285] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.542438] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1298.542508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.542724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1298.542870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1298.552705] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: IN_PROGRESS for 2s [ 1300.152462] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.152832] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1300.568064] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: SUCCESS [ 1300.568064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.568064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.568322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.568451] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.568548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.568548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.568860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.568987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.569188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.569306] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.072268] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.574633] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 255ec5a6-942e-49be-b759-c091160337f6: rpc.has_security_group_logging(os_id): False [ 1301.592255] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.592455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1301.592588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.592927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1301.610014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1301.610339] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.610459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1301.610527] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.610715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1301.610792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1301.610883] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 255ec5a6-942e-49be-b759-c091160337f6 is going to be updated. [ 1301.666974] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.667192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1301.667297] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.667542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1301.667738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1301.680083] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: IN_PROGRESS for 2s [ 1301.964658] env[62620]: INFO networking_nsxv3.common.synchronization [req-9488fd18-7d5b-438e-b924-5b9e0b7fdb1a req-f8a4df8a-e3ae-4b4a-9f22-5ba264657990 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1301.965254] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1301.965565] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.966286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1301.966361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.966571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1301.966738] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.966845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1301.966920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.967083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1301.967170] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1301.967263] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.438563] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.438826] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.438967] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.439263] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.439530] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.439700] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.439827] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.440065] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.440224] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.440439] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.440563] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1302.440681] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1302.440798] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1302.440913] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.441034] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1302.441176] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1302.461950] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1302.462144] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1302.462293] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1302.462474] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.462779] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-00c086aa-5c1a-4b1e-8f68-aea4434492ea taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.462956] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-00c086aa-5c1a-4b1e-8f68-aea4434492ea" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.463104] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-00c086aa-5c1a-4b1e-8f68-aea4434492ea" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.463435] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-00c086aa-5c1a-4b1e-8f68-aea4434492ea" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.463585] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00c086aa-5c1a-4b1e-8f68-aea4434492ea',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.469365] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.965845] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.966229] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.966304] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.966740] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.967021] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.967313] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 00c086aa-5c1a-4b1e-8f68-aea4434492ea not found, creating... [ 1302.967789] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.968101] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.968279] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.968553] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.968784] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.969238] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.969431] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.969570] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.969869] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.970091] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.970211] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 00c086aa-5c1a-4b1e-8f68-aea4434492ea is going to be created. [ 1302.971366] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.996438] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.996719] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.996838] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.997140] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.997654] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.997729] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-00c086aa-5c1a-4b1e-8f68-aea4434492ea" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1303.476961] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.477347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1303.477347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.477610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1303.477610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1303.477610] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1303.511176] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.511458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1303.511458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.511691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1303.511786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1303.520107] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1303.706089] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: SUCCESS [ 1303.706331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1303.729418] env[62620]: INFO networking_nsxv3.common.synchronization [req-9488fd18-7d5b-438e-b924-5b9e0b7fdb1a req-5cb31d34-1e20-43d4-b356-cdff3615bc71 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1303.729712] env[62620]: INFO networking_nsxv3.common.synchronization [req-9488fd18-7d5b-438e-b924-5b9e0b7fdb1a req-5cb31d34-1e20-43d4-b356-cdff3615bc71 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1303.729969] env[62620]: INFO networking_nsxv3.common.synchronization [req-9488fd18-7d5b-438e-b924-5b9e0b7fdb1a req-5cb31d34-1e20-43d4-b356-cdff3615bc71 service nova] Enqueued Resource ID: 00c086aa-5c1a-4b1e-8f68-aea4434492ea with Priority: HIGHEST for action port [ 1303.730681] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1303.730821] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1303.730918] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00c086aa-5c1a-4b1e-8f68-aea4434492ea with Priority: HIGHEST for action port [ 1303.731463] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.731463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1303.731463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.731678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1303.731678] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.732697] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.732697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1303.732877] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-00c086aa-5c1a-4b1e-8f68-aea4434492ea taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.732977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00c086aa-5c1a-4b1e-8f68-aea4434492ea" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1303.733052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00c086aa-5c1a-4b1e-8f68-aea4434492ea" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.733501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00c086aa-5c1a-4b1e-8f68-aea4434492ea" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1303.733501] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00c086aa-5c1a-4b1e-8f68-aea4434492ea',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.235085] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.235635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1304.235635] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00c086aa-5c1a-4b1e-8f68-aea4434492ea with status ACTIVE [ 1304.235635] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.235845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1304.235845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.235953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1304.236064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1304.236243] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.236338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1304.236401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.236604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1304.236693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1304.236834] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.236957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1304.237030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.237175] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1304.237254] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1304.237337] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00c086aa-5c1a-4b1e-8f68-aea4434492ea is going to be updated. [ 1304.261256] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.261423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1304.261462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.261671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1304.261815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1304.261971] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00c086aa-5c1a-4b1e-8f68-aea4434492ea" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1305.529430] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1305.529736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1305.529837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.530076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1305.530269] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.530385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1305.530454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.530756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1305.530857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1305.530959] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.032839] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.535066] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.037777] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.037995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.037995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.038264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.038352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.038460] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1307.066272] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.066446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.066446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.066654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.066896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.074773] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1308.732382] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.732794] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1309.085753] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1309.085968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.086242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.086474] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.086682] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.086809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.086873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.087050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.087147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.087238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.087374] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.590659] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.590871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.590975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.591503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.591590] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.593051] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.593051] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.593051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.593593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.593593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.593593] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.095220] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea919c93-c5eb-459f-869f-c9c9eae06e59: rpc.has_security_group_logging(os_id): False [ 1310.113451] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.113704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.113851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.114177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.114363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.114630] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.114885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.114969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.115202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.115311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.115539] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.115684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.115771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.115949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.116056] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.116279] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.116513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.116602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.116781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.116879] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.116989] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1310.177455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.177641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.177641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.177897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.178108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.190952] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1312.207309] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1312.207628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1313.732969] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.733209] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1314.625134] env[62620]: INFO networking_nsxv3.common.synchronization [req-149bf9ae-d7bf-41aa-8fc1-7ea514b3c7dc req-34f061f9-d286-4d8e-a812-146be91cd8d3 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1314.625134] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1314.625237] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.625295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1314.625354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.625548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1314.625704] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.625828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1314.627467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.627702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1314.627821] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1314.627931] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.131596] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.634324] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.137306] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.137724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1316.137724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.137807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1316.137891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1316.137998] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1316.167497] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.167702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1316.167702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.167906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1316.168072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1316.177744] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1318.188118] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1318.188575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1319.625891] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.626223] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.874880] env[62620]: INFO networking_nsxv3.common.synchronization [req-5bb73d86-b4d7-43f0-89da-8ca805ba633e req-d06640d1-66e8-4cac-a9a1-3a3fe8c7d7a7 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1323.875122] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1323.875268] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.875384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1323.875450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.875643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1323.875786] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.875875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1323.875974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.876101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1323.876180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1323.876267] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.159782] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.160062] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1324.160163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.160471] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1324.160742] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.160909] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1324.161051] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.161283] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1324.161434] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1324.161676] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1324.161772] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1324.161892] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1324.162017] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1324.162138] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1324.162253] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1324.162393] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1324.182246] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1324.182246] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1324.182246] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1324.182422] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1324.182552] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.182722] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1324.182849] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.183171] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1324.183321] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aca5f16-116e-4907-b0dc-1f1cd6bc60ef',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.379386] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.686956] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.687243] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1324.687405] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.687730] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1324.687902] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1324.688093] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 0aca5f16-116e-4907-b0dc-1f1cd6bc60ef not found, creating... [ 1324.688468] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.688559] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1324.688651] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.688886] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1324.689073] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1324.689462] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.689560] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1324.689680] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.689917] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1324.690075] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1324.690240] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 0aca5f16-116e-4907-b0dc-1f1cd6bc60ef is going to be created. [ 1324.714650] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.714867] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1324.715011] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.715315] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1324.715616] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1324.715873] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1324.882200] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.385118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.385282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.385322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.385523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1325.385611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1325.385713] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1325.416260] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.416432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.416555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.416681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1325.416850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1325.421600] env[62620]: INFO networking_nsxv3.common.synchronization [req-5bb73d86-b4d7-43f0-89da-8ca805ba633e req-6af30c07-3bb1-4178-8226-f11e9d4ff12b service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1325.421777] env[62620]: INFO networking_nsxv3.common.synchronization [req-5bb73d86-b4d7-43f0-89da-8ca805ba633e req-6af30c07-3bb1-4178-8226-f11e9d4ff12b service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1325.421920] env[62620]: INFO networking_nsxv3.common.synchronization [req-5bb73d86-b4d7-43f0-89da-8ca805ba633e req-6af30c07-3bb1-4178-8226-f11e9d4ff12b service nova] Enqueued Resource ID: 0aca5f16-116e-4907-b0dc-1f1cd6bc60ef with Priority: HIGHEST for action port [ 1325.422186] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1325.422315] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1325.422440] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aca5f16-116e-4907-b0dc-1f1cd6bc60ef with Priority: HIGHEST for action port [ 1325.422934] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.423062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.423163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.423306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1325.423386] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.424230] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.424324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.424510] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.424605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.424669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.424823] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1325.424894] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aca5f16-116e-4907-b0dc-1f1cd6bc60ef',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.426238] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1325.926896] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.926896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.926896] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0aca5f16-116e-4907-b0dc-1f1cd6bc60ef with status ACTIVE [ 1325.927378] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.927441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.927492] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.927707] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1325.927883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1325.928035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.928124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.928190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.928349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1325.928429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1325.928616] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.928710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.928772] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.928966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1325.929081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1325.929155] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0aca5f16-116e-4907-b0dc-1f1cd6bc60ef is going to be updated. [ 1325.951321] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.951321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1325.951321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.951321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1325.951321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1325.951321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aca5f16-116e-4907-b0dc-1f1cd6bc60ef" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1327.436196] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1327.436559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1327.436615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.436820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1327.437056] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.437198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1327.437300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.437521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1327.437631] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1327.437771] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.939948] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.442614] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.944926] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.945105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1328.945165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.945382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1328.945479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1328.945631] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1328.971135] env[62620]: INFO networking_nsxv3.common.synchronization [req-665f932b-615f-4fd2-a7ae-6704507294f2 req-ba185d92-cca0-45d2-a692-3f7367646eaf tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1328.971661] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1328.972690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.972812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1328.972851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.973270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1328.973270] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1328.974694] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.974694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1328.974694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.974881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1328.974938] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.975054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1328.975122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.975297] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1328.975390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1328.975526] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.984376] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1329.477516] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.477991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1329.477991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.477991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1329.499172] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1329.499377] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.499895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1329.499895] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.500213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1329.500213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1329.500362] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be updated. [ 1329.524204] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.524500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1329.524845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.524845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1329.525070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1329.534594] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 1330.995478] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1330.995901] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1330.996070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.996360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1330.996660] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.996898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1330.996998] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.997281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1330.997423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1330.997578] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1330.997731] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.501701] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.501701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1331.501701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.501701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1331.501701] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.502074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1331.502074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.502074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1331.502178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1331.502178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1331.502348] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.502432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1331.502468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.502612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1331.502746] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.502838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1331.502899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.503041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1331.503121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1331.503203] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1331.503291] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.543201] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 1331.543395] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 deletion is rescheduled due to dependency. [ 1331.543512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1332.006091] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea919c93-c5eb-459f-869f-c9c9eae06e59: rpc.has_security_group_logging(os_id): False [ 1332.031936] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.032094] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1332.032238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.032607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1332.032607] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1332.032835] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.033149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1332.033149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.033300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1332.033300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1332.033488] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.033576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1332.033690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.033763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1332.033825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1332.034021] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.034120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1332.034199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.034307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1332.034374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1332.034456] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1332.096145] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.096307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1332.096362] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.096534] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1332.096679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1332.109469] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1333.972406] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.972735] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1334.063649] env[62620]: INFO networking_nsxv3.common.synchronization [req-2fd33279-741e-4328-b83d-b3ca250d0765 req-04cc542e-6877-4a2d-a5f1-832b5c2932d4 tempest-ServerActionsTestOtherB-764568701 tempest-ServerActionsTestOtherB-764568701-project-member] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1334.064587] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1334.065053] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.065224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1334.065316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.065615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1334.065848] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.065988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1334.066091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.066304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1334.066664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1334.066664] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.124116] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1334.124453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1334.569773] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.569995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1334.570096] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.570373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1334.570504] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1334.570734] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.570859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1334.570932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.571197] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1334.571335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1334.571458] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1334.602036] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.602036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1334.602036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.602331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1334.602459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1334.610946] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1335.657973] env[62620]: INFO networking_nsxv3.common.synchronization [req-c7d52801-5d4e-415b-9d6e-81293abccabb req-c97258cd-13a1-4a77-92da-5c48b4c3ecb2 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1335.658519] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1335.658822] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.658947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1335.659046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.659269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1335.659425] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.659528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1335.659589] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.659734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1335.659818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1335.659908] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.055030] env[62620]: INFO networking_nsxv3.common.synchronization [req-18f7efbf-9cf2-4974-b494-39571afdde48 req-60aff28d-b09f-4ce8-99c3-2fc0a6be93a4 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_members [ 1336.055431] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGHEST for action security_group_members [ 1336.055738] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-09255348-01e0-470e-b2fe-9b59aa2a53dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.055858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1336.055927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.056143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1336.056290] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.056385] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1336.056450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.056595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1336.056692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1336.056788] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.165025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.558736] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.558899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1336.558973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.559269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1336.559387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1336.559584] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.559689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1336.559753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.559899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1336.559979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1336.560080] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd is going to be updated. [ 1336.588016] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.588139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1336.588182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.588342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1336.588471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1336.597182] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd in Status: IN_PROGRESS for 2s [ 1336.617374] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1336.617522] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 deletion is rescheduled due to dependency. [ 1336.617619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1336.667101] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.169562] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.169731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1337.169806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.170067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1337.170171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1337.170270] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1337.219395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.219598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1337.219598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.219808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1337.219952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1337.228165] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1337.953965] env[62620]: INFO networking_nsxv3.common.synchronization [req-07be5e9d-0f04-4813-b9a6-f5fa6290cc28 req-04a89d41-95a5-481f-89d1-2b3924833489 tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1337.954506] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1337.954812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.954932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1337.954998] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.955216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1337.955368] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.955468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1337.955531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.955675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1337.955759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1337.955847] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.238992] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-636 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.239296] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.239491] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.239844] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.240174] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.240365] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.240513] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.240772] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.240972] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.241241] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1338.241406] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1338.241523] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1338.241664] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1338.241797] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1338.241945] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1338.242120] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1338.264161] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1338.264355] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1338.264505] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1338.264671] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.265042] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-4cbd817b-c3ef-4a33-8648-4297830602e0 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.265343] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-4cbd817b-c3ef-4a33-8648-4297830602e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.265415] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-4cbd817b-c3ef-4a33-8648-4297830602e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.265746] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-4cbd817b-c3ef-4a33-8648-4297830602e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.265893] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cbd817b-c3ef-4a33-8648-4297830602e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.460221] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.460399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.460399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.460609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.460704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.460905] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.461010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.461079] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.461229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.461306] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.461414] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be updated. [ 1338.488790] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.488952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.488993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.489220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.489356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.497743] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 1338.606358] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd in Status: SUCCESS [ 1338.606543] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd deletion is rescheduled due to dependency. [ 1338.606655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.768345] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.768570] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.768707] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.769117] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.769245] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.769412] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 4cbd817b-c3ef-4a33-8648-4297830602e0 not found, creating... [ 1338.769676] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.769846] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.769973] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.770254] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.770405] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.770692] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.770856] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.770982] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.771211] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.771367] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.771676] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 4cbd817b-c3ef-4a33-8648-4297830602e0 is going to be created. [ 1338.791772] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.791945] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1338.792091] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.792642] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1338.792642] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1338.792751] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-4cbd817b-c3ef-4a33-8648-4297830602e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1339.237576] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1339.237861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1339.479031] env[62620]: INFO networking_nsxv3.common.synchronization [req-07be5e9d-0f04-4813-b9a6-f5fa6290cc28 req-68e695f3-65eb-4179-bb59-9edbe86958d4 service nova] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 1339.480043] env[62620]: INFO networking_nsxv3.common.synchronization [req-07be5e9d-0f04-4813-b9a6-f5fa6290cc28 req-68e695f3-65eb-4179-bb59-9edbe86958d4 service nova] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1339.480300] env[62620]: INFO networking_nsxv3.common.synchronization [req-07be5e9d-0f04-4813-b9a6-f5fa6290cc28 req-68e695f3-65eb-4179-bb59-9edbe86958d4 service nova] Enqueued Resource ID: 4cbd817b-c3ef-4a33-8648-4297830602e0 with Priority: HIGHEST for action port [ 1339.480557] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 1339.480764] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1339.480903] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cbd817b-c3ef-4a33-8648-4297830602e0 with Priority: HIGHEST for action port [ 1339.481513] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.481688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1339.481782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.482018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1339.482128] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.483509] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.483622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1339.483828] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cbd817b-c3ef-4a33-8648-4297830602e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.483933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cbd817b-c3ef-4a33-8648-4297830602e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1339.484045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cbd817b-c3ef-4a33-8648-4297830602e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.484290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cbd817b-c3ef-4a33-8648-4297830602e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1339.484433] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cbd817b-c3ef-4a33-8648-4297830602e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.986219] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.986384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1339.988037] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cbd817b-c3ef-4a33-8648-4297830602e0 with status ACTIVE [ 1339.988037] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.988037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1339.988037] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.988264] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1339.988348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1339.988697] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.988697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1339.988697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.988831] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1339.988864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1339.989023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.989146] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1339.989236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.989341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1339.989416] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1339.989501] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cbd817b-c3ef-4a33-8648-4297830602e0 is going to be updated. [ 1340.011074] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.011215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1340.011301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.011460] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1340.011660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1340.011825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cbd817b-c3ef-4a33-8648-4297830602e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1340.507470] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 1340.507813] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 deletion is rescheduled due to dependency. [ 1340.507952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1340.508161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.508407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1340.508630] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.508820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1340.508945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.509228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1340.509320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1340.509421] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.012240] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.514066] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.737820] env[62620]: INFO networking_nsxv3.common.synchronization [None req-e1a18a1f-eff8-403f-9f6d-9f2fb2dba620 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_rules [ 1341.737820] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_rules [ 1341.737820] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e3d709-39db-4789-9664-b707d1759c5b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.737820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1341.737820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.738333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1341.738449] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.806596] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d9fa1c02-b5aa-4cf8-be7d-31f9fc43354f tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_rules [ 1341.807084] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_rules [ 1341.807393] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e3d709-39db-4789-9664-b707d1759c5b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.807490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1342.016485] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.016718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1342.016832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.017207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1342.017407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1342.017512] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be updated. [ 1342.045485] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.045633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1342.045699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.045907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1342.046064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1342.057333] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 1342.264069] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.264471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1342.264575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.264786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1342.264879] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1342.264982] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e3d709-39db-4789-9664-b707d1759c5b already deleted. [ 1342.265088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1342.265581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.265746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1342.265834] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.786758] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.787080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1342.787080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.787186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1342.787279] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1342.787372] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e3d709-39db-4789-9664-b707d1759c5b already deleted. [ 1342.787453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1343.531182] env[62620]: INFO networking_nsxv3.common.synchronization [req-d0604498-ce93-4f35-9d60-6edca64d12bc req-e35333ed-b6ca-47b9-aa93-d2f7fe0df9fa tempest-ServerActionsTestOtherB-764568701 tempest-ServerActionsTestOtherB-764568701-project-member] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1343.531290] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1343.531640] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.531727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1343.531793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.531988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1343.532299] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.532443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1343.532524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.532691] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1343.532777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1343.533605] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.839044] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.839391] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1343.839469] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.839743] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1343.840032] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.840217] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1343.840348] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.840590] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1343.840744] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1343.840959] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1343.841099] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1343.841225] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1343.841341] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1343.841454] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1343.841569] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1343.841711] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1343.861596] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1343.861768] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1343.861914] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1343.862114] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1343.862424] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-71c1451f-de1d-4700-8326-282bc39bb6f7 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.862596] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1343.862722] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.863054] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1343.863206] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71c1451f-de1d-4700-8326-282bc39bb6f7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.035689] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.035932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1344.035932] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.036092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1344.036225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1344.036385] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.036488] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1344.036552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.036701] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1344.036777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1344.036862] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1344.060520] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.060685] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1344.060743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.060878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1344.061017] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1344.069173] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1344.365343] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.365497] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1344.365636] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.365954] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1344.366128] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1344.366290] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 71c1451f-de1d-4700-8326-282bc39bb6f7 not found, creating... [ 1344.366552] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.366719] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1344.366846] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.367102] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1344.367284] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1344.367572] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.367735] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1344.367860] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.368090] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1344.368233] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1344.368380] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 71c1451f-de1d-4700-8326-282bc39bb6f7 is going to be created. [ 1344.389327] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.389546] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1344.389721] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.390016] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1344.390258] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1344.390497] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1344.890688] env[62620]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/realized-state/status', 'params': {'intent_path': '/infra/domains/default/groups/b84c6a20-87b1-462b-accd-d32f1296df07'}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1344.891029] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62620) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:122}} [ 1345.071697] env[62620]: INFO networking_nsxv3.common.synchronization [req-d0604498-ce93-4f35-9d60-6edca64d12bc req-f4d7393d-ed0a-4cb7-8742-4622b212f54b service nova] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 1345.071876] env[62620]: INFO networking_nsxv3.common.synchronization [req-d0604498-ce93-4f35-9d60-6edca64d12bc req-f4d7393d-ed0a-4cb7-8742-4622b212f54b service nova] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1345.072154] env[62620]: INFO networking_nsxv3.common.synchronization [req-d0604498-ce93-4f35-9d60-6edca64d12bc req-f4d7393d-ed0a-4cb7-8742-4622b212f54b service nova] Enqueued Resource ID: 71c1451f-de1d-4700-8326-282bc39bb6f7 with Priority: HIGHEST for action port [ 1345.072732] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 1345.072935] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1345.073322] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71c1451f-de1d-4700-8326-282bc39bb6f7 with Priority: HIGHEST for action port [ 1345.073886] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.074091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.074232] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.074656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.074756] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.075861] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.076071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.076677] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-71c1451f-de1d-4700-8326-282bc39bb6f7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.076677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.076677] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.076860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.077041] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71c1451f-de1d-4700-8326-282bc39bb6f7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.578972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.579131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.581450] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71c1451f-de1d-4700-8326-282bc39bb6f7 with status ACTIVE [ 1345.581627] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.581739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.581811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.582201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.582298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1345.582474] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.582572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.582642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.582800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.582877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1345.583070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.583168] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.583227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.583368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.583443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1345.583527] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71c1451f-de1d-4700-8326-282bc39bb6f7 is going to be updated. [ 1345.610867] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.611059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.611126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.611292] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.611458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1345.611585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1345.691878] env[62620]: INFO networking_nsxv3.common.synchronization [req-182a16c2-b3bf-4e0f-9147-691ce43ae0e8 req-47eb3aff-72ff-411f-82d3-74246b87c153 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1345.692418] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1345.693097] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.693238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.693314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.693522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.693686] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.693799] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.693864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.694033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.694121] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1345.694234] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.980469] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.980763] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.980801] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.981091] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.981357] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.981543] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1345.981676] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.981901] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1345.982068] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1345.982292] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1345.982417] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1345.982533] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1345.982649] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1345.982765] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1345.982878] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1345.983025] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1346.000057] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1346.000130] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1346.000298] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1346.000487] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.000776] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-f488b8ce-9270-489a-862c-8166c83c1bdc taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.000985] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-f488b8ce-9270-489a-862c-8166c83c1bdc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1346.001134] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-f488b8ce-9270-489a-862c-8166c83c1bdc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.001464] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-f488b8ce-9270-489a-862c-8166c83c1bdc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1346.001626] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f488b8ce-9270-489a-862c-8166c83c1bdc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.077046] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1346.077177] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 deletion is rescheduled due to dependency. [ 1346.077283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.077434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.077642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1346.077849] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.078016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1346.078092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.078256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1346.078340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.078434] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.196448] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.504059] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.504326] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1346.504436] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.504727] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1346.504885] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.505065] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port f488b8ce-9270-489a-862c-8166c83c1bdc not found, creating... [ 1346.505340] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.505506] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1346.505630] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.505852] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1346.505998] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.506302] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.506462] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1346.506585] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.506795] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1346.506933] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.507162] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: f488b8ce-9270-489a-862c-8166c83c1bdc is going to be created. [ 1346.525350] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.525559] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1346.525715] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.525990] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1346.526242] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.526573] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-f488b8ce-9270-489a-862c-8166c83c1bdc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.580290] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.699314] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.899658] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 1346.899826] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.899988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.900282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1346.900490] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.900610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1346.900680] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.900836] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1346.900922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.901018] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1346.901109] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.082414] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.204775] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.204942] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.205442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.205442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.205442] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.205442] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1347.232833] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.232962] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.233040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.233242] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.233383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.240051] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1347.289207] env[62620]: INFO networking_nsxv3.common.synchronization [req-182a16c2-b3bf-4e0f-9147-691ce43ae0e8 req-eb2b5c06-9790-46b3-b487-600511023799 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1347.289413] env[62620]: INFO networking_nsxv3.common.synchronization [req-182a16c2-b3bf-4e0f-9147-691ce43ae0e8 req-eb2b5c06-9790-46b3-b487-600511023799 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1347.289614] env[62620]: INFO networking_nsxv3.common.synchronization [req-182a16c2-b3bf-4e0f-9147-691ce43ae0e8 req-eb2b5c06-9790-46b3-b487-600511023799 service nova] Enqueued Resource ID: f488b8ce-9270-489a-862c-8166c83c1bdc with Priority: HIGHEST for action port [ 1347.289852] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1347.290050] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1347.290114] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f488b8ce-9270-489a-862c-8166c83c1bdc with Priority: HIGHEST for action port [ 1347.290777] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.290856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.291035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.291418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.291512] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.292455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.292550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.293123] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-f488b8ce-9270-489a-862c-8166c83c1bdc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.293123] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f488b8ce-9270-489a-862c-8166c83c1bdc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.293123] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f488b8ce-9270-489a-862c-8166c83c1bdc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.293123] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f488b8ce-9270-489a-862c-8166c83c1bdc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.293123] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f488b8ce-9270-489a-862c-8166c83c1bdc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.403341] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.584703] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.584908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.585061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.585282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.585421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.585533] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1347.609704] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.609841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.609912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.610141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.610283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.617874] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1347.796914] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.796914] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.799371] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f488b8ce-9270-489a-862c-8166c83c1bdc with status ACTIVE [ 1347.799588] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.799719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.799788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.800008] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.800104] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.800308] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.800412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.800491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.800654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.800734] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.800913] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.801016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.801089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.801229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.801304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.801387] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f488b8ce-9270-489a-862c-8166c83c1bdc is going to be updated. [ 1347.820455] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.820590] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.820661] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.820846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.821041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.821146] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f488b8ce-9270-489a-862c-8166c83c1bdc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.904985] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b84c6a20-87b1-462b-accd-d32f1296df07: rpc.has_security_group_logging(os_id): False [ 1347.914913] env[62620]: INFO networking_nsxv3.common.synchronization [req-26af1cb3-a686-4433-b81a-6fb6321a1369 req-1105fad3-60f4-4b6a-b4dd-261b2fe892f4 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_members [ 1347.915257] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_members [ 1347.915983] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e3d709-39db-4789-9664-b707d1759c5b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.916138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.916202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.916498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.916770] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.917327] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.917412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.917638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.917757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.917878] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.927686] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.927926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.927998] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.928195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.928288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.928526] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.928627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.928692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.928884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.928968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1347.928999] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be updated. [ 1347.995667] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.995803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1347.995877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.996198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1347.996336] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.008809] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 1348.241008] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.241295] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1348.241358] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.241629] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1348.241891] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.242064] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1348.242192] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.242413] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1348.242561] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.242770] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1348.242890] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1348.243011] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1348.243130] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1348.243248] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1348.243363] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1348.243500] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1348.262728] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1348.262885] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1348.263037] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1348.263210] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-290" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.263482] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-e8d180db-2d86-4c84-b9dc-877a37a56877 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.263647] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-e8d180db-2d86-4c84-b9dc-877a37a56877" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1348.263774] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-e8d180db-2d86-4c84-b9dc-877a37a56877" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.264078] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-e8d180db-2d86-4c84-b9dc-877a37a56877" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1348.264224] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8d180db-2d86-4c84-b9dc-877a37a56877',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.421927] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.422131] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1348.422202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.422384] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1348.422490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.422720] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.422827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1348.422894] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.423060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1348.423141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.423226] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e3d709-39db-4789-9664-b707d1759c5b already deleted. [ 1348.423308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.766829] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.767220] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1348.767463] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.767803] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1348.768019] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.768236] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port e8d180db-2d86-4c84-b9dc-877a37a56877 not found, creating... [ 1348.768590] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.768851] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1348.769042] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.769355] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1348.769550] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.769998] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.770293] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1348.770473] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.770740] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1348.770906] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.771113] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: e8d180db-2d86-4c84-b9dc-877a37a56877 is going to be created. [ 1348.789895] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.790157] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1348.790364] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.790682] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1348.790965] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1348.791265] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-e8d180db-2d86-4c84-b9dc-877a37a56877" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1349.249311] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1349.250032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1349.250032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.250032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1349.250172] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.250290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1349.250290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.250448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1349.250531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1349.250626] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.506173] env[62620]: INFO networking_nsxv3.common.synchronization [req-26af1cb3-a686-4433-b81a-6fb6321a1369 req-1b5ce316-c605-42ee-985a-dd0adc5c8e5f service nova] Enqueued Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_rules [ 1349.506487] env[62620]: INFO networking_nsxv3.common.synchronization [req-26af1cb3-a686-4433-b81a-6fb6321a1369 req-1b5ce316-c605-42ee-985a-dd0adc5c8e5f service nova] Enqueued Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_members [ 1349.506744] env[62620]: INFO networking_nsxv3.common.synchronization [req-26af1cb3-a686-4433-b81a-6fb6321a1369 req-1b5ce316-c605-42ee-985a-dd0adc5c8e5f service nova] Enqueued Resource ID: e8d180db-2d86-4c84-b9dc-877a37a56877 with Priority: HIGHEST for action port [ 1349.507470] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_rules [ 1349.507687] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_members [ 1349.507850] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8d180db-2d86-4c84-b9dc-877a37a56877 with Priority: HIGHEST for action port [ 1349.508274] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e3d709-39db-4789-9664-b707d1759c5b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.508464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1349.508588] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.508897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1349.509053] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.510095] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e3d709-39db-4789-9664-b707d1759c5b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.510219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1349.510310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.510669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1349.510669] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.510801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1349.510801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.510907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1349.510992] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1349.511085] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.512118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8d180db-2d86-4c84-b9dc-877a37a56877 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.512224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8d180db-2d86-4c84-b9dc-877a37a56877" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1349.512325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8d180db-2d86-4c84-b9dc-877a37a56877" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.512587] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8d180db-2d86-4c84-b9dc-877a37a56877" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1349.512587] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8d180db-2d86-4c84-b9dc-877a37a56877',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.628205] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1349.628397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1349.628546] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.628774] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1349.628968] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.629095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1349.629240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.629522] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1349.629621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1349.629877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1349.629980] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.753200] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.014602] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.015412] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e3d709-39db-4789-9664-b707d1759c5b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.015557] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.015631] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8d180db-2d86-4c84-b9dc-877a37a56877 with status ACTIVE [ 1350.015795] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.015973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.015973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.016200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1350.016298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.016490] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.016575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.016686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.016782] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1350.016828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.017396] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.017396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.017396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.017396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1350.017396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.018153] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8d180db-2d86-4c84-b9dc-877a37a56877 is going to be updated. [ 1350.022491] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 1350.022491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.040602] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.040725] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.040795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.040984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1350.041129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.041282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8d180db-2d86-4c84-b9dc-877a37a56877" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.132208] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.255600] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.519144] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.634293] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1536c72e-7b4e-46f0-a419-8f3b5002e371: rpc.has_security_group_logging(os_id): False [ 1350.652095] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.652244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.652296] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.652487] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1350.652581] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.652827] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.652929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.652995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.653162] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1350.653240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.653326] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1350.724684] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.724902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.724949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.725179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1350.725332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.736174] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1350.757689] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.757815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.757882] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.758108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1350.758198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.758297] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1350.809789] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.809958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1350.810029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.810291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1350.810449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1350.819727] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1351.021780] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.021937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1351.023078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.023078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1351.023078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1351.023078] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e3d709-39db-4789-9664-b707d1759c5b is going to be created. [ 1351.046448] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.046448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1351.046642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.046699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1351.046910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1351.062015] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e3d709-39db-4789-9664-b707d1759c5b in Status: UNINITIALIZED for 2s [ 1352.748196] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1352.748538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1352.831234] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1352.831450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1352.831611] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.831837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1352.832043] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.832164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1352.832231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.832389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1352.832466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1352.832554] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1352.832646] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.071672] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e3d709-39db-4789-9664-b707d1759c5b in Status: SUCCESS [ 1353.071923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.072138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.072379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.072602] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.072747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.072821] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.072995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.073111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.073200] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.073295] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.335539] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.335767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.335818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.336233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.336233] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.336322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.336412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.336808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.336808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.336808] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.337054] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.337054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.337182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.337280] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.337445] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.337543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.337615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.337756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.337832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.337907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.338020] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.575600] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.840467] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea919c93-c5eb-459f-869f-c9c9eae06e59: rpc.has_security_group_logging(os_id): False [ 1353.857899] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.858083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.858124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.858335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.858426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.858618] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.858716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.858786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.858938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.859024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.859241] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.859342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.859403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.859550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.859625] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.859838] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.859935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.859996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.860148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.860240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.860334] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1353.918339] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.918491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1353.918616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.918765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1353.918908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1353.934654] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1354.078461] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6e3d709-39db-4789-9664-b707d1759c5b: rpc.has_security_group_logging(os_id): False [ 1354.104306] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.104549] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1354.104629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.104850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1354.104945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1354.105244] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.105399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1354.105513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.105638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1354.105736] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1354.105856] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e3d709-39db-4789-9664-b707d1759c5b is going to be created. [ 1354.191152] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.191446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1354.191446] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.191633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1354.191902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1354.201943] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e3d709-39db-4789-9664-b707d1759c5b in Status: IN_PROGRESS for 2s [ 1354.508680] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.508857] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1355.952934] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1355.953343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1356.213777] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e3d709-39db-4789-9664-b707d1759c5b in Status: SUCCESS [ 1356.214055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1359.509936] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.510378] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.541133] env[62620]: INFO networking_nsxv3.common.synchronization [req-129f2c74-f226-43a6-bac9-3c855b5bdc04 req-33d7ec8c-3668-4d39-a37b-a43984f7f5c1 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1360.541688] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1360.541996] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.542133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1360.542205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.542451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1360.542702] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.542933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1360.543021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.547455] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1360.547566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1360.547672] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.809589] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.809878] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1360.810080] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.810397] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1360.810678] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.810851] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1360.810978] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.811369] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1360.811532] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1360.811782] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.811910] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1360.812039] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1360.812160] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1360.812280] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.812393] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1360.812534] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1360.836922] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1360.837091] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1360.837239] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1360.837414] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1360.837702] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-2e697b33-f9f6-4771-a3e6-a129565bbd17 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.837873] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-2e697b33-f9f6-4771-a3e6-a129565bbd17" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1360.838007] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-2e697b33-f9f6-4771-a3e6-a129565bbd17" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.838318] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-2e697b33-f9f6-4771-a3e6-a129565bbd17" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1360.838468] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e697b33-f9f6-4771-a3e6-a129565bbd17',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.050605] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.340887] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.341141] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1361.341277] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.341673] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1361.341753] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1361.341921] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 2e697b33-f9f6-4771-a3e6-a129565bbd17 not found, creating... [ 1361.342207] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.342376] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1361.342508] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.342748] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1361.342894] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1361.343193] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.343360] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1361.343489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.343704] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1361.343848] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1361.343993] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 2e697b33-f9f6-4771-a3e6-a129565bbd17 is going to be created. [ 1361.364940] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.365225] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1361.365382] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.365712] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1361.365997] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1361.366286] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-2e697b33-f9f6-4771-a3e6-a129565bbd17" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1361.553435] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.040300] env[62620]: INFO networking_nsxv3.common.synchronization [req-129f2c74-f226-43a6-bac9-3c855b5bdc04 req-569f37be-c994-4d3b-85ac-2fa11b314818 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1362.040516] env[62620]: INFO networking_nsxv3.common.synchronization [req-129f2c74-f226-43a6-bac9-3c855b5bdc04 req-569f37be-c994-4d3b-85ac-2fa11b314818 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1362.040671] env[62620]: INFO networking_nsxv3.common.synchronization [req-129f2c74-f226-43a6-bac9-3c855b5bdc04 req-569f37be-c994-4d3b-85ac-2fa11b314818 service nova] Enqueued Resource ID: 2e697b33-f9f6-4771-a3e6-a129565bbd17 with Priority: HIGHEST for action port [ 1362.040897] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1362.041038] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1362.041148] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e697b33-f9f6-4771-a3e6-a129565bbd17 with Priority: HIGHEST for action port [ 1362.041693] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.041820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.041889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.042188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.042273] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.043127] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.043234] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.043436] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e697b33-f9f6-4771-a3e6-a129565bbd17 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.043533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e697b33-f9f6-4771-a3e6-a129565bbd17" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.043619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e697b33-f9f6-4771-a3e6-a129565bbd17" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.043819] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e697b33-f9f6-4771-a3e6-a129565bbd17" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.043934] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e697b33-f9f6-4771-a3e6-a129565bbd17',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.055286] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.055427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.055427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.055605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.056010] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1362.056010] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1362.088684] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.088868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.088868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.089049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.089198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1362.097657] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1362.512374] env[62620]: INFO networking_nsxv3.common.synchronization [req-0e1e030e-4bf3-4d94-81a5-e865df342d9a req-ccdd4381-040a-47df-afe4-d89b0f86643f tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 1362.512945] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 1362.513270] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.513396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.513473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.513666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.513816] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.513911] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.513991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.514153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.514249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1362.514350] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.545972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.546192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.548543] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e697b33-f9f6-4771-a3e6-a129565bbd17 with status ACTIVE [ 1362.548850] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.548935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.549057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.549432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.549561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1362.549760] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.549869] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.549928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.550129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.550214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1362.550464] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.550608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.550672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.550832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.550909] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1362.550996] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e697b33-f9f6-4771-a3e6-a129565bbd17 is going to be updated. [ 1362.576077] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.576469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1362.576469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.576558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1362.576867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1362.576867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e697b33-f9f6-4771-a3e6-a129565bbd17" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1363.017143] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.520088] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.022102] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.022510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1364.022510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.022595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1364.022717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1364.022839] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 255ec5a6-942e-49be-b759-c091160337f6 is going to be updated. [ 1364.049783] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.049989] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1364.050043] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.050233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1364.050392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1364.060349] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: IN_PROGRESS for 2s [ 1364.106376] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1364.106641] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1364.106806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.106984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1364.107239] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.107404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1364.107507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.107645] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1364.107744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1364.107818] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.610250] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.113017] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.615816] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.615986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1365.616076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.616409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1365.616507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1365.616618] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1365.647165] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.647314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1365.647360] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.647571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1365.647714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1365.657478] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1366.069860] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: SUCCESS [ 1366.070119] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1367.513836] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.513836] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1367.673135] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1367.673303] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1367.673457] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.673722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1367.673943] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.674105] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1367.674180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.674362] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1367.674454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1367.674560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1367.674672] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.177527] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.177727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1368.177727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.177946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1368.178141] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.178244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1368.178308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.178461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1368.178550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.178639] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.178789] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.178885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1368.178947] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.179108] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1368.179246] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.179338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1368.179435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.179571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1368.179648] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.179731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.179820] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.682706] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea919c93-c5eb-459f-869f-c9c9eae06e59: rpc.has_security_group_logging(os_id): False [ 1368.699654] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.699861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1368.699861] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.700050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1368.700182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.700517] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.700676] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1368.700746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.700919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1368.701009] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.701223] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.701334] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1368.701399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.701556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1368.701633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.701858] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.701969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1368.702045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.702208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1368.702286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.702391] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1368.764585] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.764788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1368.764827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.765042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1368.765194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.784506] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1370.806751] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1370.807138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1372.028036] env[62620]: INFO networking_nsxv3.common.synchronization [req-8609f690-0c4d-4391-8230-6756f8fa7580 req-8f993e1b-926c-4102-842d-680ede6122d7 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1372.028414] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1372.028733] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.028854] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1372.028919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.029130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1372.029287] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.029428] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1372.029500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.029647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1372.029731] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1372.029822] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.532239] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.035427] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.537534] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.537705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1373.537761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.537954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1373.538126] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1373.538238] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1373.569238] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.569389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1373.569493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.569696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1373.569844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1373.578262] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1373.947306] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1373.947506] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1375.588890] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1375.589294] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1377.029704] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.029967] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.557391] env[62620]: INFO networking_nsxv3.common.synchronization [req-41f043ef-4c62-4218-85ae-46a466215994 req-0e0b0b74-1114-45a1-a8f8-e3d6d8a6fcf1 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1378.557391] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1378.557391] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.557981] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1378.558067] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.558275] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1378.558456] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.558561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1378.558623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.559098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1378.559206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1378.559329] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.995472] env[62620]: INFO networking_nsxv3.common.synchronization [req-3bee67f9-277d-4c17-8d37-28a03c181e1b req-507b991c-5b9b-41e4-93b6-cc99b753d54a tempest-ServerActionsTestOtherA-1289442600 tempest-ServerActionsTestOtherA-1289442600-project-member] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 1378.995697] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGHEST for action security_group_members [ 1378.996034] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.996148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1378.996216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.996423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1378.996576] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.996674] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1378.996737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.996881] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1378.996991] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1378.997069] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.062385] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.499814] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.499981] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1379.500038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.500276] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1379.500367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1379.500630] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.500732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1379.500796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.500949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1379.501044] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1379.501135] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 255ec5a6-942e-49be-b759-c091160337f6 is going to be updated. [ 1379.535593] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.535759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1379.535835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.536047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1379.536187] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1379.544912] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: IN_PROGRESS for 2s [ 1379.564336] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.066957] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.067141] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1380.067215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.067498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1380.067619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1380.067724] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1380.103107] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.103269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1380.103331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.103538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1380.103686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1380.112870] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1381.555206] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 255ec5a6-942e-49be-b759-c091160337f6 in Status: SUCCESS [ 1381.555593] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 255ec5a6-942e-49be-b759-c091160337f6 deletion is rescheduled due to dependency. [ 1381.555593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1382.123197] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 4s [ 1383.997494] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.997855] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1384.134228] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1384.134372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1387.788382] env[62620]: INFO networking_nsxv3.common.synchronization [None req-f366fd1b-1804-4023-96d2-2317eb148b88 None None] Enqueued Resource ID: ea011926-2e8a-47c8-b203-b9b3d84def8e with Priority: HIGHEST for action port [ 1387.788382] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea011926-2e8a-47c8-b203-b9b3d84def8e with Priority: HIGHEST for action port [ 1387.788382] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea011926-2e8a-47c8-b203-b9b3d84def8e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.788382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea011926-2e8a-47c8-b203-b9b3d84def8e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1387.788382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea011926-2e8a-47c8-b203-b9b3d84def8e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.790183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea011926-2e8a-47c8-b203-b9b3d84def8e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1387.790381] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea011926-2e8a-47c8-b203-b9b3d84def8e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.924079] env[62620]: INFO networking_nsxv3.common.synchronization [req-ba20ff63-c4f4-4b2f-b4f3-61b363717bf9 req-ff9e40be-e434-4b0c-87d4-3defd715ccd2 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1387.924560] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1387.924861] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.924984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1387.925059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.925253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1387.925403] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.925492] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1387.925551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.926027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1387.926169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1387.926296] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.295016] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea011926-2e8a-47c8-b203-b9b3d84def8e [ 1388.295016] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.295016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1388.295016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.295016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1388.295016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1388.295016] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea011926-2e8a-47c8-b203-b9b3d84def8e already deleted. [ 1388.295016] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea011926-2e8a-47c8-b203-b9b3d84def8e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1388.429752] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.460510] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.463383] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1388.463383] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.463383] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1388.463383] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.463383] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1388.463383] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.463383] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1388.463383] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1388.463819] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1388.463819] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1388.463819] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1388.463819] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1388.463985] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1388.463985] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1388.464146] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1388.488378] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1388.489031] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1388.489031] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1388.489031] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1388.489254] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.489437] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1388.489940] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.489940] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1388.490128] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.820408] env[62620]: INFO networking_nsxv3.common.synchronization [None req-54fb0f90-a3f1-4ad1-823c-fe6867461d1c tempest-AttachVolumeShelveTestJSON-1329357808 tempest-AttachVolumeShelveTestJSON-1329357808-project-member] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_rules [ 1388.822973] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_rules [ 1388.822973] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.822973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1388.822973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.822973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1388.823372] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.896865] env[62620]: INFO networking_nsxv3.common.synchronization [None req-b2827dd1-d670-40fb-beae-e65bc814ad2b tempest-AttachVolumeShelveTestJSON-1329357808 tempest-AttachVolumeShelveTestJSON-1329357808-project-member] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_rules [ 1388.896865] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_rules [ 1388.896865] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.896865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1388.930980] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.992009] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.992283] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1388.992421] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.992720] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1388.992922] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1388.993140] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a not found, creating... [ 1388.993421] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.993589] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1388.993716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.993994] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1388.994162] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1388.994469] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.994636] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1388.994772] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.994999] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1388.995253] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1388.995435] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a is going to be created. [ 1389.014647] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.014848] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.014989] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.015236] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.015468] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1389.015695] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1389.344532] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.344793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.344873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.345041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.345136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1389.345235] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a already deleted. [ 1389.345322] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1389.345465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.345622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.345701] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.433253] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.433417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.433503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.433688] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.433766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1389.433855] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1389.461558] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.461858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.461934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.462150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.462290] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1389.470870] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1389.492394] env[62620]: INFO networking_nsxv3.common.synchronization [None req-550bcda9-6bc3-400e-8813-c4baaf96e3ef None None] Enqueued Resource ID: 162e5ad8-1ccd-4ede-b40e-980ec4c3de0e with Priority: HIGHEST for action port [ 1389.492394] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162e5ad8-1ccd-4ede-b40e-980ec4c3de0e with Priority: HIGHEST for action port [ 1389.492661] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-162e5ad8-1ccd-4ede-b40e-980ec4c3de0e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.492803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-162e5ad8-1ccd-4ede-b40e-980ec4c3de0e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.492871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-162e5ad8-1ccd-4ede-b40e-980ec4c3de0e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.493161] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-162e5ad8-1ccd-4ede-b40e-980ec4c3de0e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.493247] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('162e5ad8-1ccd-4ede-b40e-980ec4c3de0e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.735133] env[62620]: INFO networking_nsxv3.common.synchronization [req-ba20ff63-c4f4-4b2f-b4f3-61b363717bf9 req-f9698de7-4fc5-4cbc-b7ae-87cd604716e2 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1389.735133] env[62620]: INFO networking_nsxv3.common.synchronization [req-ba20ff63-c4f4-4b2f-b4f3-61b363717bf9 req-f9698de7-4fc5-4cbc-b7ae-87cd604716e2 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1389.735279] env[62620]: INFO networking_nsxv3.common.synchronization [req-ba20ff63-c4f4-4b2f-b4f3-61b363717bf9 req-f9698de7-4fc5-4cbc-b7ae-87cd604716e2 service nova] Enqueued Resource ID: 8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a with Priority: HIGHEST for action port [ 1389.735508] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1389.735639] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1389.735739] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a with Priority: HIGHEST for action port [ 1389.736316] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.736422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.736508] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.736684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.736770] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.737703] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.737786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.738013] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.738082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.738177] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.738401] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.738477] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.865449] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.865449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.865449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.865449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.865778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1389.865778] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a already deleted. [ 1389.865778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1389.995517] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 162e5ad8-1ccd-4ede-b40e-980ec4c3de0e [ 1389.995756] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.995888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1389.995957] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.996189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1389.996278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1389.996388] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:162e5ad8-1ccd-4ede-b40e-980ec4c3de0e already deleted. [ 1389.996451] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-162e5ad8-1ccd-4ede-b40e-980ec4c3de0e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1390.240101] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.240262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1390.241619] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a with status ACTIVE [ 1390.241619] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.241619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1390.241619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.241619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1390.241619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1390.241619] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.241619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1390.241619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.241619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1390.241619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1390.242256] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.242256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1390.242256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.242256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1390.242256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1390.242256] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a is going to be updated. [ 1390.263090] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.263281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1390.263344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.263540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1390.263682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1390.263859] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fa4a67a-bc9d-4eb2-bd67-95ca78f9cf4a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1391.481685] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1391.482102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1391.482358] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.482603] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1391.482866] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.483021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1391.483085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.483256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1391.483342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1391.483441] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.985252] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.487025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.989483] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.989668] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1392.989753] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.989980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1392.990089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1392.990188] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1393.020687] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.020868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1393.020939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.021130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1393.021289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1393.030649] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1394.230030] env[62620]: INFO networking_nsxv3.common.synchronization [req-7ad22250-4f0c-4839-a66e-c64bb6c99f41 req-500f6015-a783-44fc-a35c-93cfa322d0ef tempest-AttachVolumeShelveTestJSON-1329357808 tempest-AttachVolumeShelveTestJSON-1329357808-project-member] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_members [ 1394.231024] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_members [ 1394.231024] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.231771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1394.231874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.232176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1394.232528] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.232528] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1394.232702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.232702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1394.232777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1394.232866] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.546601] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-622 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.546741] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1394.546862] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.547235] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1394.547509] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.547685] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1394.547795] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.548309] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1394.548702] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1394.548816] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1394.548969] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1394.549110] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1394.549243] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1394.549436] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1394.549513] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1394.549959] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1394.568121] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1394.568301] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1394.568446] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1394.568629] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1394.568943] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-54f0bc09-a4b0-47de-a805-27b17f146e00 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.569137] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1394.569265] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.569582] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1394.569808] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f0bc09-a4b0-47de-a805-27b17f146e00',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.735035] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.735221] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1394.735269] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.735502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1394.735595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1394.735791] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.735891] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1394.735953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.736117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1394.736194] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1394.736278] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a already deleted. [ 1394.736359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.042055] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1395.042252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.042417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.042655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.042899] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.043053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.043129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.043295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.043394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.043535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.043605] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.072474] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.072722] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.072917] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.073326] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.073416] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.073547] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 54f0bc09-a4b0-47de-a805-27b17f146e00 not found, creating... [ 1395.073815] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.073984] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.074123] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.074356] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.074502] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.074832] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.075027] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.075231] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.075467] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.075629] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.075758] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 54f0bc09-a4b0-47de-a805-27b17f146e00 is going to be created. [ 1395.095499] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.095948] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.095948] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.096346] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.096628] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.096961] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.547067] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.547374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.547374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.547523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.547693] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.547791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.547855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.548014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.548107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.548196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.548342] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.548436] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.548498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.548638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.548774] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.548865] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.548926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.549077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.549153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.549245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.549338] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.795367] env[62620]: INFO networking_nsxv3.common.synchronization [req-7ad22250-4f0c-4839-a66e-c64bb6c99f41 req-dd0da8e5-4674-4e02-a2be-c8773f457b3f service nova] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_rules [ 1395.795367] env[62620]: INFO networking_nsxv3.common.synchronization [req-7ad22250-4f0c-4839-a66e-c64bb6c99f41 req-dd0da8e5-4674-4e02-a2be-c8773f457b3f service nova] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_members [ 1395.795367] env[62620]: INFO networking_nsxv3.common.synchronization [req-7ad22250-4f0c-4839-a66e-c64bb6c99f41 req-dd0da8e5-4674-4e02-a2be-c8773f457b3f service nova] Enqueued Resource ID: 54f0bc09-a4b0-47de-a805-27b17f146e00 with Priority: HIGHEST for action port [ 1395.795367] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_rules [ 1395.795367] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_members [ 1395.795367] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f0bc09-a4b0-47de-a805-27b17f146e00 with Priority: HIGHEST for action port [ 1395.795940] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.796391] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.796585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.796937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.797320] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.798330] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.798601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.798785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.799072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.800074] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.800074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.800074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.800074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.800074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1395.800074] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.801352] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-54f0bc09-a4b0-47de-a805-27b17f146e00 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.801485] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1395.801556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.801687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1395.801753] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f0bc09-a4b0-47de-a805-27b17f146e00',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.052581] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea919c93-c5eb-459f-869f-c9c9eae06e59: rpc.has_security_group_logging(os_id): False [ 1396.070230] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.070386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.070439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.070656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1396.070766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.070961] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.071075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.071127] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.071283] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1396.071359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.071566] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.071661] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.071724] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.071864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1396.071938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.072182] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.072331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.072431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.072539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1396.072616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.072703] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1396.146700] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.146906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.146985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.147225] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1396.147516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.168675] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1396.304139] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.304286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.304475] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.307027] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54f0bc09-a4b0-47de-a805-27b17f146e00 with status ACTIVE [ 1396.307130] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.307209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.307426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.307502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1396.307671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.307866] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.308044] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.308044] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.308309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1396.308372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.308689] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.308689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.308787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.309061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1396.309061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.309061] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54f0bc09-a4b0-47de-a805-27b17f146e00 is going to be updated. [ 1396.332118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.332323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1396.332397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.332601] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1396.332757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.332922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1396.807760] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.309828] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.309948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1397.310052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.310256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1397.310348] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1397.310452] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a is going to be created. [ 1397.355166] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.355449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1397.355449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.355593] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1397.355755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1397.366043] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: UNINITIALIZED for 2s [ 1398.214604] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1398.214955] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1399.163442] env[62620]: INFO networking_nsxv3.common.synchronization [req-9941b578-0158-4da8-84e5-8871492ffbdc req-785c2bbc-e930-4b7b-bac6-a7f004793eca tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1399.164690] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1399.164690] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.164690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1399.164690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.164690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1399.165083] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.165083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1399.165083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.165180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1399.165208] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1399.165315] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.375915] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: SUCCESS [ 1399.376341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1399.376341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.376515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1399.376711] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.376834] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1399.376900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.377068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1399.377149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1399.377236] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1399.377327] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.667179] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.879780] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.169830] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.382363] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d99f03d-15a0-459e-b7ae-a72419a0b82a: rpc.has_security_group_logging(os_id): False [ 1400.401372] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.401547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1400.401591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.401898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1400.402081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1400.402356] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.402472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1400.402543] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.402721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1400.402809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1400.402904] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a is going to be created. [ 1400.466810] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.467072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1400.467122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.467324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1400.467509] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1400.480226] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: IN_PROGRESS for 2s [ 1400.673252] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.673471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1400.673523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.673763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1400.673864] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1400.673966] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1400.711618] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.711800] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1400.711848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.712077] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1400.712227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1400.720438] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1402.491128] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: SUCCESS [ 1402.491556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1402.729888] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1402.730205] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1403.900078] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.900078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1403.900585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.900585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1403.900585] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.165332] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.165440] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1404.402970] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.908827] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.413371] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1405.413506] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1406.114084] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.114397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1406.114397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.114475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1406.127393] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1406.128235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1406.128973] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1406.166330] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.166538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1406.166628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.166892] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1406.182393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1406.183264] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1406.183374] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1406.183442] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1406.217754] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.217903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1406.217976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.218206] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1406.219567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1406.219808] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1406.294315] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.294516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1406.294516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.294732] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1406.295054] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1406.295364] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1406.370815] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.371042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1406.371042] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.371252] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1406.371533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1406.371799] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1406.371894] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f5026804-13b5-4b49-b1b4-b00084a12c8c', '78b0a132-e0e8-49ae-9afc-c9f27fc1456a', 'a3921e17-5705-42fe-988b-f0c37340437f', '20781892-13fd-4ddf-8c97-ac90186655e0', '4d99f03d-15a0-459e-b7ae-a72419a0b82a', 'b704bfdd-e753-458e-8533-d3a8d632a866', '09255348-01e0-470e-b2fe-9b59aa2a53dd', 'a7bdbdc9-465d-491e-8f58-3f3aff4b421f', '098dac2c-8d52-48ba-bfe3-5e87aaad5495', '6c76585c-33d4-4740-aca6-cc740735e2c9', '401d776d-874d-46cf-ad91-06222d321584', 'b6e3d709-39db-4789-9664-b707d1759c5b', '20f5a061-dbd0-44d6-953b-0f455ddef899', '1536c72e-7b4e-46f0-a419-8f3b5002e371', '155d9c67-3c1f-4b2c-9601-a53c9b438946', '93458070-780f-4248-9141-95ce7704bf27', '787f7736-c1a9-4a6d-8e59-532c4a82467e', '9338b344-e20e-4f2c-889d-3246eaae326d', '4a6af52c-b1fd-4489-b26c-557260173089', 'e8ef3419-3f65-45f7-8a65-b4c2453d9fb8', '522dbe7d-0c4e-456f-9be7-2144d27ebc47', '255ec5a6-942e-49be-b759-c091160337f6', '7027a4f2-13d4-467a-96da-8c378fa8ac69', 'd202a637-704d-4648-b15e-1c9cbe21b05b', '555614d8-7992-4190-9420-95843d76b986', '0a74e416-c2f5-41f6-a7d3-a2cd9c682858', '17653238-10f5-4057-bb3a-0d1116cfe7f0', '7c469d6d-346a-40a2-adb5-8c50f7758224', 'b140e556-13f7-4e22-a7d6-53ddc3943100', 'e84080db-2e0a-4513-addc-aca7401b2740', 'cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d', 'b27f6472-ff8f-4e87-ba84-3f06d7d9c925', 'd79c3337-b12e-40d4-993c-c4d5954de7b0', '84776719-6313-41bf-88fe-129baf34c6ed', 'b84c6a20-87b1-462b-accd-d32f1296df07', '16d45250-e90b-4ed6-befa-bdaacfced30b', '9f23bc15-3356-4a60-a94f-750f1fd18026', 'b2bbf04f-3b75-4f98-a58c-b7dfe66747dd', 'c72dcb51-694a-46ed-b921-12a44f522163', 'ea919c93-c5eb-459f-869f-c9c9eae06e59'} {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1406.371983] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1406.389647] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.389875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1406.389875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.390107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1406.390228] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1406.390331] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1406.390410] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1406.390506] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1406.461126] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.461318] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1406.461388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.461565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1406.462693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1406.462962] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1406.463076] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1406.463141] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1406.463190] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1406.463246] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1406.463318] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGH for action security_group_rules [ 1406.463398] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGH for action security_group_rules [ 1406.463465] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGH for action security_group_rules [ 1406.463527] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGH for action security_group_rules [ 1406.463583] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGH for action security_group_rules [ 1406.463646] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGH for action security_group_rules [ 1406.463709] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGH for action security_group_rules [ 1406.463768] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGH for action security_group_rules [ 1406.463832] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGH for action security_group_rules [ 1406.463889] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGH for action security_group_rules [ 1406.463952] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGH for action security_group_rules [ 1406.464021] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGH for action security_group_rules [ 1406.464084] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGH for action security_group_rules [ 1406.464137] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGH for action security_group_rules [ 1406.464193] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGH for action security_group_rules [ 1406.464258] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGH for action security_group_rules [ 1406.464315] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGH for action security_group_rules [ 1406.464380] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGH for action security_group_rules [ 1406.464443] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGH for action security_group_rules [ 1406.464501] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGH for action security_group_rules [ 1406.464595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.403360] env[62620]: INFO networking_nsxv3.common.synchronization [req-20b229a4-0ab8-4a22-bd0c-0f43380df851 req-fdc3e122-1a29-4ce2-a21b-e897400205a6 tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1408.403924] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1408.405172] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5026804-13b5-4b49-b1b4-b00084a12c8c with Priority: HIGH for action security_group_rules [ 1408.405172] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3921e17-5705-42fe-988b-f0c37340437f with Priority: HIGH for action security_group_rules [ 1408.406089] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd with Priority: HIGH for action security_group_rules [ 1408.406327] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 with Priority: HIGH for action security_group_rules [ 1408.406390] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 with Priority: HIGH for action security_group_rules [ 1408.406502] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a6af52c-b1fd-4489-b26c-557260173089 with Priority: HIGH for action security_group_rules [ 1408.406602] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9338b344-e20e-4f2c-889d-3246eaae326d with Priority: HIGH for action security_group_rules [ 1408.406700] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e with Priority: HIGH for action security_group_rules [ 1408.406789] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGH for action security_group_rules [ 1408.406906] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93458070-780f-4248-9141-95ce7704bf27 with Priority: HIGH for action security_group_rules [ 1408.407020] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 with Priority: HIGH for action security_group_rules [ 1408.407146] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGH for action security_group_rules [ 1408.407214] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401d776d-874d-46cf-ad91-06222d321584 with Priority: HIGH for action security_group_rules [ 1408.407428] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 with Priority: HIGH for action security_group_rules [ 1408.407428] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 with Priority: HIGH for action security_group_rules [ 1408.407591] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b704bfdd-e753-458e-8533-d3a8d632a866 with Priority: HIGH for action security_group_rules [ 1408.407591] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f with Priority: HIGH for action security_group_rules [ 1408.407709] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGH for action security_group_rules [ 1408.407764] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a with Priority: HIGH for action security_group_rules [ 1408.407843] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20781892-13fd-4ddf-8c97-ac90186655e0 with Priority: HIGH for action security_group_rules [ 1408.408153] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.408281] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.408375] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.408540] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.408696] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.408793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.408855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.408986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.409082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.409178] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.410093] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5026804-13b5-4b49-b1b4-b00084a12c8c taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.410171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.410250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.410393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.410469] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5026804-13b5-4b49-b1b4-b00084a12c8c',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.411310] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3921e17-5705-42fe-988b-f0c37340437f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.411432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.411432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.411711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.411711] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3921e17-5705-42fe-988b-f0c37340437f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.412744] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09255348-01e0-470e-b2fe-9b59aa2a53dd taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.412801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.412878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.413011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.413085] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09255348-01e0-470e-b2fe-9b59aa2a53dd',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.414039] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-155d9c67-3c1f-4b2c-9601-a53c9b438946 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.414039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.414039] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.414250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.414250] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('155d9c67-3c1f-4b2c-9601-a53c9b438946',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.414799] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.414923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.414987] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.415302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.415302] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8ef3419-3f65-45f7-8a65-b4c2453d9fb8',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.415856] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a6af52c-b1fd-4489-b26c-557260173089 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.415984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.416055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.416235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.416302] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a6af52c-b1fd-4489-b26c-557260173089',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.417138] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9338b344-e20e-4f2c-889d-3246eaae326d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.417250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.417250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.417387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.417972] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9338b344-e20e-4f2c-889d-3246eaae326d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.418132] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787f7736-c1a9-4a6d-8e59-532c4a82467e taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.418237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.418301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.418448] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.418519] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787f7736-c1a9-4a6d-8e59-532c4a82467e',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.419190] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.419870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.419870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.419870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.419870] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.421133] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93458070-780f-4248-9141-95ce7704bf27 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.421133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.421133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.421133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.421133] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93458070-780f-4248-9141-95ce7704bf27',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.421537] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5a061-dbd0-44d6-953b-0f455ddef899 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.421642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.421721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.421918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.421918] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5a061-dbd0-44d6-953b-0f455ddef899',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.422624] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e3d709-39db-4789-9664-b707d1759c5b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.422678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.422742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.422888] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.422954] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.423621] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401d776d-874d-46cf-ad91-06222d321584 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.423719] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.423781] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.423976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.424027] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401d776d-874d-46cf-ad91-06222d321584',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.426120] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c76585c-33d4-4740-aca6-cc740735e2c9 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.426120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.426120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.426120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.426120] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c76585c-33d4-4740-aca6-cc740735e2c9',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.426120] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.426120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.426120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.426120] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.426478] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('098dac2c-8d52-48ba-bfe3-5e87aaad5495',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.427026] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b704bfdd-e753-458e-8533-d3a8d632a866 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.427026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.427237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.427399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.427474] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b704bfdd-e753-458e-8533-d3a8d632a866',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.428174] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.428355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.428429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.428584] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.428717] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7bdbdc9-465d-491e-8f58-3f3aff4b421f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.429319] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.429429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.429489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.429638] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.429709] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.430393] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.430506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.430571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.430717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.430806] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b0a132-e0e8-49ae-9afc-c9f27fc1456a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.431491] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20781892-13fd-4ddf-8c97-ac90186655e0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.431597] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.431664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.431848] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.431903] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20781892-13fd-4ddf-8c97-ac90186655e0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.440024] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.461289] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.461449] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.461491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.461694] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.479493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.479626] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787f7736-c1a9-4a6d-8e59-532c4a82467e is going to be deleted. [ 1408.528354] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.528354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.528354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.528354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.528354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.528354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787f7736-c1a9-4a6d-8e59-532c4a82467e" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.714734] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.715256] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.715513] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.715940] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.716617] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.716807] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.717036] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.717399] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.717743] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.718370] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1408.718495] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1408.718649] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1408.718789] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1408.718981] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1408.719132] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1408.719339] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1408.736865] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1408.737082] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1408.737239] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1408.737419] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.737718] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-9fa1aa42-f4a9-48e3-946a-48622c860506 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.737890] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-9fa1aa42-f4a9-48e3-946a-48622c860506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.738033] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-9fa1aa42-f4a9-48e3-946a-48622c860506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.738357] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-9fa1aa42-f4a9-48e3-946a-48622c860506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.738500] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa1aa42-f4a9-48e3-946a-48622c860506',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.937590] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e3d709-39db-4789-9664-b707d1759c5b taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.937812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.937812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.937985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.938164] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.938278] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.938347] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.938606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.938606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.938717] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.938757] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.954225] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.954388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.954440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.954591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.954748] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.954847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.954915] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.955072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1408.955154] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.955239] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1408.955323] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.958167] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.978529] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.978666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1408.978738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.978939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.004404] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.004404] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.009617] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.009617] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.016091] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.016091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.016624] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.016749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.017631] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.017786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.018630] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.018759] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.019517] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.019656] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.020443] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.020575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.022085] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.022085] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.022176] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.022222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.022864] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1409.023235] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.023328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.023955] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1409.024417] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.024545] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.025241] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1409.025660] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.025771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.026403] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1409.026848] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.026952] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.027613] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1409.028121] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.028274] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.029154] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1409.029561] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.029655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.030276] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1409.030796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.030920] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8ef3419-3f65-45f7-8a65-b4c2453d9fb8 is going to be deleted. [ 1409.031846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.032062] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.049427] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.050896] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5a061-dbd0-44d6-953b-0f455ddef899 is going to be deleted. [ 1409.050896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.050896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.065811] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.065992] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5026804-13b5-4b49-b1b4-b00084a12c8c is going to be deleted. [ 1409.066718] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.066920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.085210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.085356] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 155d9c67-3c1f-4b2c-9601-a53c9b438946 is going to be deleted. [ 1409.086354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.087048] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.087970] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.088421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.102978] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.104059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.106778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.106912] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be deleted. [ 1409.107889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.108024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.129815] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.129993] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.137169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.137306] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b704bfdd-e753-458e-8533-d3a8d632a866 is going to be deleted. [ 1409.138204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.138417] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.173649] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.173824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.178061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.178198] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7bdbdc9-465d-491e-8f58-3f3aff4b421f is going to be deleted. [ 1409.179090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.179307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.218842] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.218975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.230052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.230052] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a6af52c-b1fd-4489-b26c-557260173089 is going to be deleted. [ 1409.230650] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.230912] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.238963] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.239088] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.240634] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.240829] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.240985] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.241335] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.241421] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.241580] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 9fa1aa42-f4a9-48e3-946a-48622c860506 not found, creating... [ 1409.241835] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.242009] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.242142] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.242367] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.242512] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.242808] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.242976] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.243112] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.243326] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.243467] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.243613] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 9fa1aa42-f4a9-48e3-946a-48622c860506 is going to be created. [ 1409.285309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.285422] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401d776d-874d-46cf-ad91-06222d321584 is going to be deleted. [ 1409.286396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.286396] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.298956] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.299076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.304946] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.305163] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.305296] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.305549] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.305788] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.306015] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-9fa1aa42-f4a9-48e3-946a-48622c860506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.312970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.313094] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9338b344-e20e-4f2c-889d-3246eaae326d is going to be deleted. [ 1409.313868] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.314065] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.364822] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.365020] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.369179] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.369336] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20781892-13fd-4ddf-8c97-ac90186655e0 is going to be deleted. [ 1409.370386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.370604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.441570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.441871] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3921e17-5705-42fe-988b-f0c37340437f is going to be deleted. [ 1409.442681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.442901] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.446429] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.463722] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.463893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.463944] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.464134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.464227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.464325] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1409.468855] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.477355] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.477531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.478987] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.479139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.514520] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.514677] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b0a132-e0e8-49ae-9afc-c9f27fc1456a is going to be deleted. [ 1409.515624] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.515835] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.518462] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.518626] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.518673] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.518829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.518973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.531908] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1409.584794] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.584918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.596979] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.597100] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.606982] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.607130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.611313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.611836] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93458070-780f-4248-9141-95ce7704bf27 is going to be deleted. [ 1409.612400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.612619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.657413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.657562] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c76585c-33d4-4740-aca6-cc740735e2c9 is going to be deleted. [ 1409.658475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.658700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.868653] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.868827] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09255348-01e0-470e-b2fe-9b59aa2a53dd is going to be deleted. [ 1409.869681] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.869935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.894333] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.894464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.896786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.896922] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 098dac2c-8d52-48ba-bfe3-5e87aaad5495 is going to be deleted. [ 1409.897958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.898193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.898297] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.898433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8ef3419-3f65-45f7-8a65-b4c2453d9fb8" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.898609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.898824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.898937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.899072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5a061-dbd0-44d6-953b-0f455ddef899" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.899535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.899716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.899827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.899949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5026804-13b5-4b49-b1b4-b00084a12c8c" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.900102] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.900249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.900326] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.900435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-155d9c67-3c1f-4b2c-9601-a53c9b438946" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.900560] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.900700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.900784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.900900] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.901040] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.901183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.901257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.901368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b704bfdd-e753-458e-8533-d3a8d632a866" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.901492] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.901632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.901703] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.901812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7bdbdc9-465d-491e-8f58-3f3aff4b421f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.901930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.902079] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.902171] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.902288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401d776d-874d-46cf-ad91-06222d321584" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.902409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.902547] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.902619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.902751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9338b344-e20e-4f2c-889d-3246eaae326d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.902875] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.903024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.903098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.903209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a6af52c-b1fd-4489-b26c-557260173089" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.903328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.903466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.903537] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.903647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20781892-13fd-4ddf-8c97-ac90186655e0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.903771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.903907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.903985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.904129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3921e17-5705-42fe-988b-f0c37340437f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.904255] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.904397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.904471] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.904580] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b0a132-e0e8-49ae-9afc-c9f27fc1456a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.904698] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.904837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.904931] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.905069] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93458070-780f-4248-9141-95ce7704bf27" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.944825] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.944966] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.945139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.945472] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.945658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.945817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c76585c-33d4-4740-aca6-cc740735e2c9" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.947985] env[62620]: INFO networking_nsxv3.common.synchronization [req-20b229a4-0ab8-4a22-bd0c-0f43380df851 req-383ec108-9ca1-4396-a806-46ab8d5dac26 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1409.948214] env[62620]: INFO networking_nsxv3.common.synchronization [req-20b229a4-0ab8-4a22-bd0c-0f43380df851 req-383ec108-9ca1-4396-a806-46ab8d5dac26 service nova] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1409.948373] env[62620]: INFO networking_nsxv3.common.synchronization [req-20b229a4-0ab8-4a22-bd0c-0f43380df851 req-383ec108-9ca1-4396-a806-46ab8d5dac26 service nova] Enqueued Resource ID: 9fa1aa42-f4a9-48e3-946a-48622c860506 with Priority: HIGHEST for action port [ 1409.948658] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6e3d709-39db-4789-9664-b707d1759c5b: rpc.has_security_group_logging(os_id): False [ 1409.950045] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_rules [ 1409.950257] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1409.950367] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa1aa42-f4a9-48e3-946a-48622c860506 with Priority: HIGHEST for action port [ 1409.950659] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.950795] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.950860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.951046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.951198] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.951966] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.952080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.952317] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fa1aa42-f4a9-48e3-946a-48622c860506 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.952423] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fa1aa42-f4a9-48e3-946a-48622c860506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.952488] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fa1aa42-f4a9-48e3-946a-48622c860506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.952655] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fa1aa42-f4a9-48e3-946a-48622c860506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.952740] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa1aa42-f4a9-48e3-946a-48622c860506',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.954016] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.954143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.954215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.954367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.954453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.954564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09255348-01e0-470e-b2fe-9b59aa2a53dd" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.971104] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d99f03d-15a0-459e-b7ae-a72419a0b82a: rpc.has_security_group_logging(os_id): False [ 1409.997290] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.997496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1409.997496] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.997727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1409.997889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1409.998046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-098dac2c-8d52-48ba-bfe3-5e87aaad5495" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.000727] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.000908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.000908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.001101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.002499] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.002612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.051233] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.051594] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.051778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.051778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.052091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.052227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.052570] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a is going to be updated. [ 1410.053619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.053871] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.108297] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.108619] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.108745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.108837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.109075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.109165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.109257] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e3d709-39db-4789-9664-b707d1759c5b is going to be updated. [ 1410.208850] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.209082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.209139] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.210061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.210061] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.241340] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.241340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.241340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.241548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.241780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.262295] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: IN_PROGRESS for 2s [ 1410.275626] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e3d709-39db-4789-9664-b707d1759c5b in Status: IN_PROGRESS for 2s [ 1410.457089] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.457089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.457089] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fa1aa42-f4a9-48e3-946a-48622c860506 with status ACTIVE [ 1410.457089] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.457784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.457784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.457784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.457784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.457784] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.457784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.457784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.458045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.458045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.458194] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.458291] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.458353] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.458495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.458568] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.458685] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fa1aa42-f4a9-48e3-946a-48622c860506 is going to be updated. [ 1410.479125] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.479289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1410.479364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.479569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1410.479706] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1410.479902] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fa1aa42-f4a9-48e3-946a-48622c860506" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1411.306982] env[62620]: INFO networking_nsxv3.common.synchronization [req-af87af18-8ee2-4106-aecf-6b509af6e7eb req-403dd58c-9a77-4bdf-8b58-a6d3cb0fe1f0 tempest-AttachVolumeNegativeTest-1428764152 tempest-AttachVolumeNegativeTest-1428764152-project-member] Enqueued Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_members [ 1411.306982] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e3d709-39db-4789-9664-b707d1759c5b with Priority: HIGHEST for action security_group_members [ 1411.307403] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e3d709-39db-4789-9664-b707d1759c5b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.307468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1411.307521] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.307733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1411.308109] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.308246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1411.308325] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.308498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1411.308596] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1411.308698] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e3d709-39db-4789-9664-b707d1759c5b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.541752] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1411.542081] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1411.542145] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.542365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1411.542550] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.542666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1411.542730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.542883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1411.543184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1411.543285] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.812206] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.812421] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1411.812525] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.812778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1411.812903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1411.813152] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.813262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1411.813361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.813512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1411.813591] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1411.813679] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e3d709-39db-4789-9664-b707d1759c5b is going to be updated. [ 1411.848347] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.848566] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1411.848660] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.848877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1411.849034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1411.857297] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e3d709-39db-4789-9664-b707d1759c5b in Status: IN_PROGRESS for 2s [ 1412.045132] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.284118] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: SUCCESS [ 1412.284304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1412.287037] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e3d709-39db-4789-9664-b707d1759c5b in Status: SUCCESS [ 1412.287258] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1412.548025] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.049945] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.050229] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1413.050319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.050548] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1413.050642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1413.051259] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1413.077383] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.077513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1413.077612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.077812] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1413.077978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1413.085888] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1413.866976] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e3d709-39db-4789-9664-b707d1759c5b in Status: SUCCESS [ 1413.867380] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e3d709-39db-4789-9664-b707d1759c5b deletion is rescheduled due to dependency. [ 1413.867445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e3d709-39db-4789-9664-b707d1759c5b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1415.096854] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1415.097240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1415.097307] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.097483] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1415.097694] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.097816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1415.097885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.098066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1415.098149] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1415.098237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1415.098332] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.600460] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.600669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1415.600669] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.600820] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1415.601014] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.601159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1415.601214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.601342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1415.601432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1415.601523] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1415.601671] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.601766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1415.601827] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.601968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1415.602118] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.602213] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1415.602271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.602411] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1415.602486] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1415.602569] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1415.602658] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.105148] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea919c93-c5eb-459f-869f-c9c9eae06e59: rpc.has_security_group_logging(os_id): False [ 1416.124630] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.124796] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1416.124898] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.125195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1416.151873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1416.152177] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.152338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1416.152438] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.152687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1416.152807] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1416.153102] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.153251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1416.153346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.153551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1416.153666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1416.153936] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.154095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1416.154192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.154395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1416.154511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1416.154636] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1416.218432] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.218623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1416.218623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.218822] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1416.218967] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1416.235326] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1416.308070] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.308070] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1418.151363] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.151703] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1418.151703] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.152709] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1418.152709] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.152709] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1418.152709] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.152947] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1418.153113] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1418.153371] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1418.153531] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1418.153719] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1418.153830] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1418.153985] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1418.154145] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1418.154324] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1418.173391] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1418.173865] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1418.173865] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1418.174143] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-420" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1418.174502] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-71c1451f-de1d-4700-8326-282bc39bb6f7 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.174788] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1418.174893] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.175218] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1418.175403] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71c1451f-de1d-4700-8326-282bc39bb6f7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.254313] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1418.254565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1418.678448] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.678679] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1418.678815] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.679179] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1418.679356] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1418.679677] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.679851] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1418.679998] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.680255] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1418.680404] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1418.680691] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.680856] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1418.680979] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.681210] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1418.681359] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1418.681500] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 71c1451f-de1d-4700-8326-282bc39bb6f7 is going to be updated. [ 1418.705497] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.705696] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1418.705825] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.706086] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1418.706283] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1418.706513] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1419.376722] env[62620]: INFO networking_nsxv3.common.synchronization [req-95505125-9369-48fd-90ed-b2294140cdf5 req-c01c4a77-a3ea-455e-baf3-4af2595d2440 service nova] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 1419.376722] env[62620]: INFO networking_nsxv3.common.synchronization [req-95505125-9369-48fd-90ed-b2294140cdf5 req-c01c4a77-a3ea-455e-baf3-4af2595d2440 service nova] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1419.376722] env[62620]: INFO networking_nsxv3.common.synchronization [req-95505125-9369-48fd-90ed-b2294140cdf5 req-c01c4a77-a3ea-455e-baf3-4af2595d2440 service nova] Enqueued Resource ID: 71c1451f-de1d-4700-8326-282bc39bb6f7 with Priority: HIGHEST for action port [ 1419.376722] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_rules [ 1419.376722] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1419.376722] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71c1451f-de1d-4700-8326-282bc39bb6f7 with Priority: HIGHEST for action port [ 1419.376722] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.377623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.377805] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.378183] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.378362] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.379590] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.380019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.380019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.380256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.382023] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.382023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.382023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.382023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.382023] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1419.382023] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.382558] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-71c1451f-de1d-4700-8326-282bc39bb6f7 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.382767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.382920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.383164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.383330] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71c1451f-de1d-4700-8326-282bc39bb6f7',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.867312] env[62620]: INFO networking_nsxv3.common.synchronization [req-5e8ff953-24cd-4fc1-b1b7-56f3354cb292 req-35eef64a-9556-4436-8ef7-e97d644eab90 tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1419.867873] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1419.868197] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.868377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.868377] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.868822] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.868984] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.869122] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.869163] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.869338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.869413] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1419.869508] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.884573] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.884699] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.884883] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.885663] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71c1451f-de1d-4700-8326-282bc39bb6f7 with status ACTIVE [ 1419.885837] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.885949] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.886027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.886224] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.886313] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1419.886481] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.886580] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.886644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.886789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.886867] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1419.887056] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.887153] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.887215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.887355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.887429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1419.887543] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71c1451f-de1d-4700-8326-282bc39bb6f7 is going to be updated. [ 1419.908672] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.908857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1419.908916] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.909109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1419.909260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1419.909420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71c1451f-de1d-4700-8326-282bc39bb6f7" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1420.374097] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.374097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1420.374097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.374097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1420.389251] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.394210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1420.394450] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.394570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1420.394642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.394829] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1420.394929] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1420.395016] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be updated. [ 1420.423222] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.423350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1420.423406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.423541] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1420.423675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1420.431946] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 1420.891284] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.891443] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1420.891533] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.891741] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1420.891824] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1420.891929] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1420.918195] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.918339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1420.918409] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.918647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1420.918866] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1420.927457] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1422.442215] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 1422.442623] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 deletion is rescheduled due to dependency. [ 1422.442623] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1422.936492] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1422.936721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1422.936877] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.937117] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1422.937315] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.937440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1422.937501] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.937637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1422.937716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1422.937802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1422.937891] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.440488] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.526537] env[62620]: INFO networking_nsxv3.common.synchronization [req-0ab48932-56c7-491b-8c4e-7e4f593c6f58 req-c5206e55-c811-48c6-af3f-3c5745701bcd tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1423.527920] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1423.528939] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.529191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1423.529344] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.529654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1423.529901] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.530072] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1423.530174] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.530450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1423.530598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1423.530750] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.944052] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1536c72e-7b4e-46f0-a419-8f3b5002e371: rpc.has_security_group_logging(os_id): False [ 1423.961363] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.961594] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1423.961705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.962151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1423.962498] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1423.962598] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.962704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1423.962806] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.963073] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1423.963212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1423.963342] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be created. [ 1424.026025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.026025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1424.026025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.026025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1424.026025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1424.034303] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.038912] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1424.537140] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.040147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.040340] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1425.040412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.040647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1425.040745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1425.040849] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1425.065756] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.065910] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1425.065982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.066210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1425.066365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1425.079479] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1426.052022] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1426.052431] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.037336] env[62620]: INFO networking_nsxv3.common.synchronization [req-4c7e8e7a-3f8e-4921-8e93-5a68a5f3134a req-46f653aa-0364-4153-bab4-2ef2f178556b tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1427.038117] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1427.038236] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.038408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.038497] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.038700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.038857] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.038961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.039038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.039260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.039349] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.039439] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.089282] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1427.089635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.351678] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-636 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.351678] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.351972] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.352143] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.352411] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.352578] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.352701] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.352936] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.353101] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.353331] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1427.353452] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1427.353572] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1427.353689] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1427.353805] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1427.353919] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1427.354100] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1427.371990] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1427.372174] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1427.372322] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1427.372503] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-636" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.372799] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-238d30ee-1280-409d-89ff-3c112db3c2d4 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.372969] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-238d30ee-1280-409d-89ff-3c112db3c2d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.373113] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-238d30ee-1280-409d-89ff-3c112db3c2d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.373427] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-238d30ee-1280-409d-89ff-3c112db3c2d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.373575] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('238d30ee-1280-409d-89ff-3c112db3c2d4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.542223] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.542468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.542468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.542672] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.542767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.542972] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.543099] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.543166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.543316] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.543395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.543484] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be updated. [ 1427.566196] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.566364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.566406] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.567055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.567055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.574470] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 1427.879811] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.879811] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.879811] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.879811] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.879811] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.879811] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 238d30ee-1280-409d-89ff-3c112db3c2d4 not found, creating... [ 1427.879811] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.879811] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.880462] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.880462] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.880462] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.880676] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.880841] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.880980] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.881230] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.881378] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.881527] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 238d30ee-1280-409d-89ff-3c112db3c2d4 is going to be created. [ 1427.902403] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.902403] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1427.902517] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.902775] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1427.903403] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1427.903403] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-238d30ee-1280-409d-89ff-3c112db3c2d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1428.614172] env[62620]: INFO networking_nsxv3.common.synchronization [req-4c7e8e7a-3f8e-4921-8e93-5a68a5f3134a req-1c5ff7eb-93fc-473a-96b8-a79c4b056cd5 service nova] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 1428.614428] env[62620]: INFO networking_nsxv3.common.synchronization [req-4c7e8e7a-3f8e-4921-8e93-5a68a5f3134a req-1c5ff7eb-93fc-473a-96b8-a79c4b056cd5 service nova] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1428.614520] env[62620]: INFO networking_nsxv3.common.synchronization [req-4c7e8e7a-3f8e-4921-8e93-5a68a5f3134a req-1c5ff7eb-93fc-473a-96b8-a79c4b056cd5 service nova] Enqueued Resource ID: 238d30ee-1280-409d-89ff-3c112db3c2d4 with Priority: HIGHEST for action port [ 1428.615126] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_rules [ 1428.615274] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1428.615413] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 238d30ee-1280-409d-89ff-3c112db3c2d4 with Priority: HIGHEST for action port [ 1428.617335] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.617335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1428.617335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.617335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1428.617335] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.617813] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.617935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1428.618244] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-238d30ee-1280-409d-89ff-3c112db3c2d4 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.618403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-238d30ee-1280-409d-89ff-3c112db3c2d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1428.618403] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-238d30ee-1280-409d-89ff-3c112db3c2d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.618573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-238d30ee-1280-409d-89ff-3c112db3c2d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1428.618667] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('238d30ee-1280-409d-89ff-3c112db3c2d4',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.121315] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 238d30ee-1280-409d-89ff-3c112db3c2d4 with status ACTIVE [ 1429.121529] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.122745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1429.122745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.122745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1429.122745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1429.122745] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.122745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1429.122745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.122745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1429.122745] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1429.123082] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.123082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1429.123082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.123245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1429.123245] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1429.123317] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 238d30ee-1280-409d-89ff-3c112db3c2d4 is going to be updated. [ 1429.124658] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.124756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1429.147920] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.148130] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1429.148196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.148392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1429.148542] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1429.148705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-238d30ee-1280-409d-89ff-3c112db3c2d4" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1429.583346] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 1429.583649] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 deletion is rescheduled due to dependency. [ 1429.583649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1429.583804] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.583917] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1429.584113] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.584259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1429.584343] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.584450] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1429.584531] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1429.584615] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.086645] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.589450] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.092232] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.092571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1431.092571] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.092700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1431.092789] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1431.092889] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be updated. [ 1431.120214] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.120371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1431.120412] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.120692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1431.120844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1431.128316] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 1431.551049] env[62620]: INFO networking_nsxv3.common.synchronization [req-a077a8e6-afd7-4458-a874-54f1a8396027 req-601d963f-87b7-4804-879e-48e144413f9c tempest-ServersTestJSON-494939627 tempest-ServersTestJSON-494939627-project-member] Enqueued Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1431.551542] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 with Priority: HIGHEST for action security_group_members [ 1431.551849] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea919c93-c5eb-459f-869f-c9c9eae06e59 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.551970] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1431.552050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.552282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1431.552401] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.552500] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1431.552561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.552709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1431.552790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1431.552886] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea919c93-c5eb-459f-869f-c9c9eae06e59',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.057025] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.057147] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1432.057237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.057422] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1432.057515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1432.057718] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.057818] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1432.057876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.058057] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1432.058151] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1432.058239] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 is going to be updated. [ 1432.083801] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.083946] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1432.083986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.084189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1432.084332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1432.091983] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: IN_PROGRESS for 2s [ 1433.138101] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 1433.138101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1433.138101] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.138515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1433.138515] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.138515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1433.138515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.138692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1433.138692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1433.138787] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1433.138878] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.640854] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.101718] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 in Status: SUCCESS [ 1434.101903] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea919c93-c5eb-459f-869f-c9c9eae06e59 deletion is rescheduled due to dependency. [ 1434.102026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea919c93-c5eb-459f-869f-c9c9eae06e59" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1434.142919] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b84c6a20-87b1-462b-accd-d32f1296df07: rpc.has_security_group_logging(os_id): False [ 1434.159301] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.159490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1434.159536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.159733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1434.160321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1434.160321] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.160321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1434.160321] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.160558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1434.160558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1434.160558] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be updated. [ 1434.219076] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.219227] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1434.219300] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.219510] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1434.219657] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1434.231189] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 1436.245158] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 1436.245512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1436.552275] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.552456] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1437.736596] env[62620]: INFO networking_nsxv3.common.synchronization [req-610fc2ee-c2bf-4234-b267-e4c855f934c9 req-e058805b-ed0b-4f30-a954-987b8d0669f8 tempest-ServerActionsTestOtherB-764568701 tempest-ServerActionsTestOtherB-764568701-project-member] Enqueued Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1437.737131] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 with Priority: HIGHEST for action security_group_members [ 1437.737440] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-1536c72e-7b4e-46f0-a419-8f3b5002e371 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.737562] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1437.737635] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.737845] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1437.737999] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.738111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1437.738186] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.738323] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1437.738408] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1437.738498] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1536c72e-7b4e-46f0-a419-8f3b5002e371',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.241055] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.241055] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1438.241251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.241452] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1438.241582] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1438.241915] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.242074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1438.242184] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.242382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1438.242478] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1438.242593] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 is going to be updated. [ 1438.282843] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.282979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1438.283082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.283253] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1438.283394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1438.293411] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: IN_PROGRESS for 2s [ 1440.305641] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 in Status: SUCCESS [ 1440.306050] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1536c72e-7b4e-46f0-a419-8f3b5002e371 deletion is rescheduled due to dependency. [ 1440.306050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1536c72e-7b4e-46f0-a419-8f3b5002e371" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1442.738720] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.738720] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.533420] env[62620]: INFO networking_nsxv3.common.synchronization [None req-767110d7-cd60-45fc-b2c6-2cb62521f6b5 None None] Enqueued Resource ID: 1b37d42e-1851-4365-9c1c-9953320719cb with Priority: HIGHEST for action port [ 1447.533688] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b37d42e-1851-4365-9c1c-9953320719cb with Priority: HIGHEST for action port [ 1447.534597] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b37d42e-1851-4365-9c1c-9953320719cb taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.534730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b37d42e-1851-4365-9c1c-9953320719cb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1447.534801] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b37d42e-1851-4365-9c1c-9953320719cb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.535164] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b37d42e-1851-4365-9c1c-9953320719cb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1447.535257] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b37d42e-1851-4365-9c1c-9953320719cb',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.012022] env[62620]: INFO networking_nsxv3.common.synchronization [None req-d979789e-237d-4baa-8f14-26d099c44191 tempest-AttachVolumeTestJSON-1790956899 tempest-AttachVolumeTestJSON-1790956899-project-member] Enqueued Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_rules [ 1448.012022] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_rules [ 1448.012298] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.012476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1448.012476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.012742] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1448.012825] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.037240] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b37d42e-1851-4365-9c1c-9953320719cb [ 1448.037493] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.037630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1448.037700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.037924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1448.038032] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1448.038132] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b37d42e-1851-4365-9c1c-9953320719cb already deleted. [ 1448.038243] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b37d42e-1851-4365-9c1c-9953320719cb" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1448.095338] env[62620]: INFO networking_nsxv3.common.synchronization [None req-915a6991-c41d-4248-884b-92e2da05f333 tempest-AttachVolumeTestJSON-1790956899 tempest-AttachVolumeTestJSON-1790956899-project-member] Enqueued Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_rules [ 1448.095338] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_rules [ 1448.095338] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.095338] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1448.533395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.533565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1448.533838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.533878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1448.533978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1448.534087] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc already deleted. [ 1448.534176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1448.534335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.534489] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1448.534575] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.052962] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.053150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1449.053202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.053424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1449.053518] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1449.053619] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc already deleted. [ 1449.053705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1449.359956] env[62620]: INFO networking_nsxv3.common.synchronization [None req-099b8610-32d6-46ce-aa0b-7ec5cb173e22 None None] Enqueued Resource ID: 6d2b8c33-3144-452e-8961-fb3231ed1e0b with Priority: HIGHEST for action port [ 1449.360549] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d2b8c33-3144-452e-8961-fb3231ed1e0b with Priority: HIGHEST for action port [ 1449.360852] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d2b8c33-3144-452e-8961-fb3231ed1e0b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.360974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d2b8c33-3144-452e-8961-fb3231ed1e0b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1449.361289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d2b8c33-3144-452e-8961-fb3231ed1e0b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.361433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d2b8c33-3144-452e-8961-fb3231ed1e0b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1449.361520] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d2b8c33-3144-452e-8961-fb3231ed1e0b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.864450] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d2b8c33-3144-452e-8961-fb3231ed1e0b [ 1449.864773] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.864933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1449.865051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.865439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1449.865439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1449.865581] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d2b8c33-3144-452e-8961-fb3231ed1e0b already deleted. [ 1449.865644] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d2b8c33-3144-452e-8961-fb3231ed1e0b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1453.508731] env[62620]: INFO networking_nsxv3.common.synchronization [req-1aa85775-0ce1-45cb-a6f9-e2bc4be5f4a8 req-947f14bd-e044-4867-84de-a0a834d53398 tempest-AttachVolumeTestJSON-1790956899 tempest-AttachVolumeTestJSON-1790956899-project-member] Enqueued Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_members [ 1453.509335] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_members [ 1453.509683] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.509817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1453.509953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.510166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1453.510575] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.510704] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1453.510779] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.510974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1453.511059] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1453.511160] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.779088] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.779088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-944" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1453.779088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-944" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.779088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-944" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1453.779088] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.779088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1453.779088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.779088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1453.779088] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1453.779862] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1453.780156] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1453.782942] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1453.782942] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1453.782942] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1453.782942] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1453.782942] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1453.800812] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1453.800812] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1453.800812] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1453.801094] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-944" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1453.801258] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.801461] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1453.801593] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.801915] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1453.802109] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ce94b7-c449-47bc-b068-3f8eca9f22f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.013877] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.014060] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1454.014129] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.014329] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1454.014426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1454.014655] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.014784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1454.014814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.015052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1454.015052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1454.015420] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc already deleted. [ 1454.015420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1454.307303] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.307303] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1454.307303] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.307303] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1454.307303] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1454.307303] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port b7ce94b7-c449-47bc-b068-3f8eca9f22f0 not found, creating... [ 1454.307303] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.307303] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1454.307303] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.307303] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1454.307303] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1454.307666] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.307666] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1454.307666] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.307666] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1454.307666] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1454.308413] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: b7ce94b7-c449-47bc-b068-3f8eca9f22f0 is going to be created. [ 1454.331875] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.331875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1454.331875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.331875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1454.331875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1454.331875] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1455.457403] env[62620]: INFO networking_nsxv3.common.synchronization [req-1aa85775-0ce1-45cb-a6f9-e2bc4be5f4a8 req-d1275107-d842-4ece-bb1f-61515f980bb8 service nova] Enqueued Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_rules [ 1455.457690] env[62620]: INFO networking_nsxv3.common.synchronization [req-1aa85775-0ce1-45cb-a6f9-e2bc4be5f4a8 req-d1275107-d842-4ece-bb1f-61515f980bb8 service nova] Enqueued Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_members [ 1455.457750] env[62620]: INFO networking_nsxv3.common.synchronization [req-1aa85775-0ce1-45cb-a6f9-e2bc4be5f4a8 req-d1275107-d842-4ece-bb1f-61515f980bb8 service nova] Enqueued Resource ID: b7ce94b7-c449-47bc-b068-3f8eca9f22f0 with Priority: HIGHEST for action port [ 1455.457996] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_rules [ 1455.458145] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_members [ 1455.458248] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7ce94b7-c449-47bc-b068-3f8eca9f22f0 with Priority: HIGHEST for action port [ 1455.458847] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.458976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1455.459058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.459265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1455.459351] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.460202] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.460368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1455.460440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.460602] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1455.460753] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.460884] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1455.460927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.461049] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1455.461135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1455.461228] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.461973] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.462389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1455.462467] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.462622] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1455.462698] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ce94b7-c449-47bc-b068-3f8eca9f22f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.964544] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.964743] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1455.964891] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.965835] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7ce94b7-c449-47bc-b068-3f8eca9f22f0 with status ACTIVE [ 1455.966045] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.966176] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1455.966249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.966479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1455.966573] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1455.966750] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.966858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1455.966923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.967109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1455.967192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1455.967393] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.967505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1455.967555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.967693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1455.967766] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1455.967956] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7ce94b7-c449-47bc-b068-3f8eca9f22f0 is going to be updated. [ 1455.988041] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.988202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1455.988285] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.988945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1455.988945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1455.988945] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7ce94b7-c449-47bc-b068-3f8eca9f22f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1456.470053] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.973019] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.973218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1456.973289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.973524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1456.973618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1456.973720] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc is going to be created. [ 1456.997052] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.997211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1456.997211] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.997387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1456.997555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1457.005533] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc in Status: UNINITIALIZED for 2s [ 1459.016681] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc in Status: SUCCESS [ 1459.017027] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1459.017148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.017374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1459.017572] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.017689] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1459.017757] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.017913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1459.018008] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1459.018103] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1459.018201] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.520656] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.023228] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc: rpc.has_security_group_logging(os_id): False [ 1460.040812] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.040974] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1460.041136] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.041368] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1460.041468] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1460.041734] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.041839] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1460.041907] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.042087] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1460.042169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1460.042257] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc is going to be created. [ 1460.093707] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.094178] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1460.094277] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.094503] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1460.094687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1460.103683] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc in Status: IN_PROGRESS for 2s [ 1460.459831] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.460034] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1462.116355] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc in Status: SUCCESS [ 1462.116793] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1465.461156] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.461535] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.461932] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.462188] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.246797] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-622 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.247162] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1474.247238] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.247450] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1474.247724] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.247890] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1474.248030] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.248255] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1474.248429] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1474.248678] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1474.248877] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1474.248932] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1474.249045] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1474.249167] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1474.249285] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1474.249426] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1474.270543] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1474.270738] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1474.270867] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1474.271072] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1474.271419] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-54f0bc09-a4b0-47de-a805-27b17f146e00 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.271607] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1474.271736] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.272056] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1474.272209] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f0bc09-a4b0-47de-a805-27b17f146e00',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.774824] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.775091] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1474.775218] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.775524] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1474.775686] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1474.775978] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.776159] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1474.776285] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.776508] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1474.776661] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1474.776949] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.777125] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1474.777250] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.777466] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1474.777611] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1474.777759] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 54f0bc09-a4b0-47de-a805-27b17f146e00 is going to be updated. [ 1474.801665] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.801851] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1474.801971] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.802214] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1474.802405] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1474.802623] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1475.463526] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.463526] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.725251] env[62620]: INFO networking_nsxv3.common.synchronization [req-30df1e2c-11a1-4e7d-a32e-7d096d587467 req-360c37c6-6a81-4160-9132-65e082b1e98d service nova] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_rules [ 1475.725251] env[62620]: INFO networking_nsxv3.common.synchronization [req-30df1e2c-11a1-4e7d-a32e-7d096d587467 req-360c37c6-6a81-4160-9132-65e082b1e98d service nova] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_members [ 1475.725251] env[62620]: INFO networking_nsxv3.common.synchronization [req-30df1e2c-11a1-4e7d-a32e-7d096d587467 req-360c37c6-6a81-4160-9132-65e082b1e98d service nova] Enqueued Resource ID: 54f0bc09-a4b0-47de-a805-27b17f146e00 with Priority: HIGHEST for action port [ 1475.725251] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_rules [ 1475.725251] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_members [ 1475.725251] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f0bc09-a4b0-47de-a805-27b17f146e00 with Priority: HIGHEST for action port [ 1475.725251] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.725251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1475.725251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.725251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1475.727553] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.727553] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.727553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1475.727553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.727553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1475.727553] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.727553] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1475.727791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.727791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1475.727851] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1475.727985] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.728721] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-54f0bc09-a4b0-47de-a805-27b17f146e00 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.728721] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1475.728878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.728935] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1475.728997] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f0bc09-a4b0-47de-a805-27b17f146e00',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.231107] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.231382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1476.231505] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.233064] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54f0bc09-a4b0-47de-a805-27b17f146e00 with status ACTIVE [ 1476.233254] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.233373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1476.233430] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.233627] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1476.233716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1476.233887] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.233984] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1476.234079] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.234244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1476.234324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1476.234505] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.234621] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1476.234696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.234857] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1476.234938] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1476.235036] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54f0bc09-a4b0-47de-a805-27b17f146e00 is going to be updated. [ 1476.255692] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.255934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1476.255934] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.256068] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1476.256191] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1476.256575] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54f0bc09-a4b0-47de-a805-27b17f146e00" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1476.733984] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.236742] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.237058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1477.237058] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.237259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1477.237357] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1477.237461] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a is going to be updated. [ 1477.272451] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.272727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1477.272727] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.272872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1477.273025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1477.281295] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: IN_PROGRESS for 2s [ 1479.292407] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: SUCCESS [ 1479.292714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1479.292714] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.292968] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1479.293192] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.293320] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1479.293484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.293595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1479.293695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1479.293792] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1479.293895] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1479.796386] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.298856] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d99f03d-15a0-459e-b7ae-a72419a0b82a: rpc.has_security_group_logging(os_id): False [ 1480.316181] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.316355] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1480.316395] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.316598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1480.316696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1480.316953] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.317066] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1480.317134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.317288] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1480.317379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1480.317454] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a is going to be updated. [ 1480.370967] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.371181] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1480.371231] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.371433] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1480.371709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1480.386202] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: IN_PROGRESS for 2s [ 1480.724635] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.724850] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1482.401858] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: SUCCESS [ 1482.402350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1485.725485] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.725928] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.342229] env[62620]: INFO networking_nsxv3.common.synchronization [req-b715b43a-d305-4968-9299-843754679ba6 req-625771c0-2e3c-4022-aa0c-59b6850f57d6 tempest-ServerActionsTestJSON-1886905081 tempest-ServerActionsTestJSON-1886905081-project-member] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1489.342778] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGHEST for action security_group_members [ 1489.343475] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.343475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1489.343475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.343475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1489.343786] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.343786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1489.343786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.343943] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1489.343979] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1489.344081] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.847063] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.847063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1489.847063] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.847387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1489.847387] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1489.847468] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.847526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1489.847564] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.847722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1489.847798] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1489.847886] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be updated. [ 1489.877266] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.877420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1489.877463] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.877628] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1489.877767] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1489.885142] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: IN_PROGRESS for 2s [ 1491.895579] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b84c6a20-87b1-462b-accd-d32f1296df07 in Status: SUCCESS [ 1491.895928] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 deletion is rescheduled due to dependency. [ 1491.895928] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1494.347639] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.347639] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.348437] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.348826] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1504.349640] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.350111] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.350711] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.351181] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1514.351974] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.352274] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1519.352962] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1519.353337] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1524.354187] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1524.354640] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1529.355254] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1529.355656] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1534.356297] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1534.356687] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.222594] env[62620]: INFO networking_nsxv3.common.synchronization [req-1ec5b00b-6ab9-4077-83c6-458d8b2905c9 req-354c9bf6-33d2-4da0-928f-ab643090590c tempest-AttachVolumeShelveTestJSON-1329357808 tempest-AttachVolumeShelveTestJSON-1329357808-project-member] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_members [ 1535.223185] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGHEST for action security_group_members [ 1535.223496] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.223629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1535.223692] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.224335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1535.224335] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.224335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1535.224335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.224642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1535.224642] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1535.224642] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.727188] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.727439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1535.727439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.727654] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1535.727747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1535.727956] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.728083] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1535.728185] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.728302] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1535.728379] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1535.728468] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a is going to be updated. [ 1535.758183] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.758356] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1535.758445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.758671] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1535.758842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1535.766287] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: IN_PROGRESS for 2s [ 1537.777511] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a in Status: SUCCESS [ 1537.777511] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a deletion is rescheduled due to dependency. [ 1537.777511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1539.839240] env[62620]: INFO networking_nsxv3.common.synchronization [None req-ded72b84-d779-43f8-bb0a-40bc54311fac tempest-AttachVolumeShelveTestJSON-1329357808 tempest-AttachVolumeShelveTestJSON-1329357808-project-member] Enqueued Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_rules [ 1539.839786] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_rules [ 1539.840061] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.840188] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1539.840251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.840538] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1539.840658] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.909121] env[62620]: INFO networking_nsxv3.common.synchronization [None req-66a81100-6ca7-4180-acad-1ddf483ac556 tempest-AttachVolumeShelveTestJSON-1329357808 tempest-AttachVolumeShelveTestJSON-1329357808-project-member] Enqueued Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_rules [ 1539.909121] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_rules [ 1539.909247] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.909247] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1540.360259] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.360397] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1540.360469] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.360687] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1540.360778] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1540.360873] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c083e00-2fed-483b-b205-18ca2016784f already deleted. [ 1540.360954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1540.361150] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.361311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1540.361393] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.880315] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.880710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1540.880710] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.880788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1540.880837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1540.880932] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c083e00-2fed-483b-b205-18ca2016784f already deleted. [ 1540.881019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1544.909692] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1544.910092] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.166239] env[62620]: INFO networking_nsxv3.common.synchronization [req-56d06bd3-dec7-48a7-bd88-c04e31896ea6 req-fb75c880-8a74-49ae-8848-2900a0811403 tempest-AttachVolumeShelveTestJSON-1329357808 tempest-AttachVolumeShelveTestJSON-1329357808-project-member] Enqueued Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_members [ 1545.166825] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_members [ 1545.167191] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.167332] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.167405] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.168169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.172151] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.172295] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.172352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.172576] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.172665] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.172710] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.412040] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-622 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.412040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.412040] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.412279] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.412453] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.412626] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.412765] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.413016] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.413193] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.413483] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1545.413619] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1545.413754] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1545.413874] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1545.414015] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1545.414164] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1545.414309] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1545.436543] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1545.436724] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1545.436851] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1545.437034] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.437324] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.437498] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.437628] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.437931] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.438090] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('374cdd5a-3b25-49a6-a1a0-45d9d5a331c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.674534] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.674715] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.674754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.674972] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.675084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.675285] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.675390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.675462] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.675600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.675679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.675761] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c083e00-2fed-483b-b205-18ca2016784f already deleted. [ 1545.675843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.939971] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.940366] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.940366] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.940758] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.940981] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.941221] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 not found, creating... [ 1545.941539] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.941746] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.941903] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.942191] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.942400] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.942727] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.942945] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.943095] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.943321] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.943467] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.943614] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 is going to be created. [ 1545.965158] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.965347] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1545.965487] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.965727] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1545.965969] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1545.966206] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1546.640275] env[62620]: INFO networking_nsxv3.common.synchronization [req-56d06bd3-dec7-48a7-bd88-c04e31896ea6 req-cf2e9a2c-fa96-4aad-80a1-135efd684b03 service nova] Enqueued Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_rules [ 1546.640507] env[62620]: INFO networking_nsxv3.common.synchronization [req-56d06bd3-dec7-48a7-bd88-c04e31896ea6 req-cf2e9a2c-fa96-4aad-80a1-135efd684b03 service nova] Enqueued Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_members [ 1546.640613] env[62620]: INFO networking_nsxv3.common.synchronization [req-56d06bd3-dec7-48a7-bd88-c04e31896ea6 req-cf2e9a2c-fa96-4aad-80a1-135efd684b03 service nova] Enqueued Resource ID: 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 with Priority: HIGHEST for action port [ 1546.640838] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_rules [ 1546.640967] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_members [ 1546.641076] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 with Priority: HIGHEST for action port [ 1546.641656] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.641784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1546.641852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.642244] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1546.642355] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.643350] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.643350] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1546.643499] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.643763] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1546.644109] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.644109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1546.644109] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.644328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1546.644454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1546.644578] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.645330] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.645495] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1546.645595] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.645784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1546.645904] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('374cdd5a-3b25-49a6-a1a0-45d9d5a331c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.147934] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.149011] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.149135] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1547.149298] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 with status ACTIVE [ 1547.149457] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.149558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1547.149619] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.149816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1547.149903] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1547.150083] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.150182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1547.150237] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.150389] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1547.150466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1547.150641] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.150729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1547.150803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.150956] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1547.151022] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1547.151075] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 is going to be updated. [ 1547.171391] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.171536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1547.171536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.172216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1547.172216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1547.172216] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1547.653070] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.155070] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.155330] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1548.155330] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.155524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1548.155615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1548.155719] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c083e00-2fed-483b-b205-18ca2016784f is going to be created. [ 1548.180139] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.180319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1548.180319] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.180477] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1548.180637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1548.191868] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: UNINITIALIZED for 2s [ 1550.202202] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: SUCCESS [ 1550.202511] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1550.202559] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.202777] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1550.202963] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.203113] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1550.203166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.203298] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1550.203378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1550.203709] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1550.203709] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.706278] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.209332] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c083e00-2fed-483b-b205-18ca2016784f: rpc.has_security_group_logging(os_id): False [ 1551.226706] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.226886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1551.226940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.227156] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1551.227250] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1551.227497] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.227600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1551.227663] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.227813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1551.227889] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1551.227974] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c083e00-2fed-483b-b205-18ca2016784f is going to be created. [ 1551.281145] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.281311] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1551.281381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.281563] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1551.281764] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1551.291805] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: IN_PROGRESS for 2s [ 1551.642315] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.642435] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1553.305502] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: SUCCESS [ 1553.305918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1556.643630] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.643630] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.644393] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1561.644800] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.645966] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.646311] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.647344] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.647344] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.648884] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.649284] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.650179] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.650481] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.652328] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.652764] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.652929] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.653227] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.654735] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.655063] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.977348] env[62620]: INFO networking_nsxv3.common.synchronization [req-c1834cbe-4459-46e4-a461-420a674925cd req-4359743e-16c4-4981-bee7-3636619afbfb tempest-AttachVolumeTestJSON-1790956899 tempest-AttachVolumeTestJSON-1790956899-project-member] Enqueued Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_members [ 1596.977348] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGHEST for action security_group_members [ 1596.977348] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.977475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1596.977544] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.977746] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1596.977887] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.977977] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1596.978047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.978513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1596.978612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1596.978703] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.480905] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.481084] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1597.481526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.481526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1597.481526] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1597.481755] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.481838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1597.481899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.482070] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1597.482148] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1597.482241] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc is going to be updated. [ 1597.509033] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.509994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1597.509994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.509994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1597.509994] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1597.517089] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc in Status: IN_PROGRESS for 2s [ 1599.527938] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc in Status: SUCCESS [ 1599.528239] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc deletion is rescheduled due to dependency. [ 1599.528361] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1601.856789] env[62620]: INFO networking_nsxv3.common.synchronization [None req-22469cd9-2ad8-449e-bf48-92a781d5a1b3 tempest-AttachVolumeTestJSON-1790956899 tempest-AttachVolumeTestJSON-1790956899-project-member] Enqueued Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_rules [ 1601.857352] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_rules [ 1601.857663] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.857784] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1601.857852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.858118] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1601.858203] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1601.931458] env[62620]: INFO networking_nsxv3.common.synchronization [None req-2e2ae7af-5f0b-4c50-b3d2-bc018c425499 tempest-AttachVolumeTestJSON-1790956899 tempest-AttachVolumeTestJSON-1790956899-project-member] Enqueued Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_rules [ 1601.931959] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_rules [ 1601.932285] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.932388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1602.377880] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.377880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1602.377880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.378204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1602.378204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1602.378265] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 already deleted. [ 1602.378386] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1602.378458] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.378615] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1602.378704] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.899018] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.899465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1602.899465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.899465] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1602.899612] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1602.899612] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 already deleted. [ 1602.899750] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1606.933491] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.933867] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1607.225894] env[62620]: INFO networking_nsxv3.common.synchronization [req-f95707a7-f17c-4f52-98af-7b0827d54bb8 req-752e92d6-f617-42c3-8f44-4ef931e19c08 tempest-AttachVolumeTestJSON-1790956899 tempest-AttachVolumeTestJSON-1790956899-project-member] Enqueued Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_members [ 1607.226413] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_members [ 1607.226726] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-927ed028-7cbb-4c68-b73f-ab8b09c596a2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.226850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1607.226927] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.227328] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1607.227496] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.227604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1607.227667] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.227874] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1607.227918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1607.227987] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1607.510339] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.510552] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-944" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1607.510723] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-944" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.511074] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-944" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1607.511472] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.511692] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1607.511917] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.512155] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1607.512331] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1607.512572] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1607.512696] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1607.512837] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1607.512963] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1607.513097] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1607.513213] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1607.513355] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1607.533294] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1607.533465] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1607.533611] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1607.533788] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-944" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1607.534125] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-82de6dd8-1d57-45fc-9263-40c89eeacaa3 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.534352] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-82de6dd8-1d57-45fc-9263-40c89eeacaa3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1607.534490] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-82de6dd8-1d57-45fc-9263-40c89eeacaa3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.534825] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-82de6dd8-1d57-45fc-9263-40c89eeacaa3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1607.534997] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82de6dd8-1d57-45fc-9263-40c89eeacaa3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1607.730129] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.730324] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1607.730371] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.730574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1607.730666] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1607.730861] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.730961] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1607.731038] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.731190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1607.731268] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1607.731353] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 already deleted. [ 1607.731435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1608.037215] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.037554] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1608.037605] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.037883] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1608.038059] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1608.038234] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Segment Port 82de6dd8-1d57-45fc-9263-40c89eeacaa3 not found, creating... [ 1608.038507] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.038673] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1608.038800] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.039047] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1608.039199] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1608.039490] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.039658] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1608.039808] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.040122] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1608.040287] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1608.040441] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 82de6dd8-1d57-45fc-9263-40c89eeacaa3 is going to be created. [ 1608.059038] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.059233] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1608.059398] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.059644] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1608.059873] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1608.060109] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-82de6dd8-1d57-45fc-9263-40c89eeacaa3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1608.734992] env[62620]: INFO networking_nsxv3.common.synchronization [req-f95707a7-f17c-4f52-98af-7b0827d54bb8 req-6882057a-b461-49c6-976f-56690c60ff9f service nova] Enqueued Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_rules [ 1608.735109] env[62620]: INFO networking_nsxv3.common.synchronization [req-f95707a7-f17c-4f52-98af-7b0827d54bb8 req-6882057a-b461-49c6-976f-56690c60ff9f service nova] Enqueued Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_members [ 1608.735264] env[62620]: INFO networking_nsxv3.common.synchronization [req-f95707a7-f17c-4f52-98af-7b0827d54bb8 req-6882057a-b461-49c6-976f-56690c60ff9f service nova] Enqueued Resource ID: 82de6dd8-1d57-45fc-9263-40c89eeacaa3 with Priority: HIGHEST for action port [ 1608.735492] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_rules [ 1608.735623] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_members [ 1608.735723] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82de6dd8-1d57-45fc-9263-40c89eeacaa3 with Priority: HIGHEST for action port [ 1608.736630] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.736760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1608.736833] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.737146] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1608.737271] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1608.738083] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-927ed028-7cbb-4c68-b73f-ab8b09c596a2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.738201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1608.738289] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.738440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1608.738587] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.738686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1608.738751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.738887] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1608.738973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1608.739075] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1608.739802] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-82de6dd8-1d57-45fc-9263-40c89eeacaa3 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.739926] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82de6dd8-1d57-45fc-9263-40c89eeacaa3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1608.739980] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82de6dd8-1d57-45fc-9263-40c89eeacaa3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.740180] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82de6dd8-1d57-45fc-9263-40c89eeacaa3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1608.740258] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82de6dd8-1d57-45fc-9263-40c89eeacaa3',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.241948] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82de6dd8-1d57-45fc-9263-40c89eeacaa3 with status ACTIVE [ 1609.242280] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.242370] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1609.242445] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.242658] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1609.242754] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1609.243015] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.243143] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1609.243210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.243372] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1609.243453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1609.243635] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.243729] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1609.243791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.243975] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1609.244089] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1609.244178] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82de6dd8-1d57-45fc-9263-40c89eeacaa3 is going to be updated. [ 1609.245351] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-927ed028-7cbb-4c68-b73f-ab8b09c596a2 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.245456] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1609.245602] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.264426] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.264561] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1609.264606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.264747] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1609.264872] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1609.265030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82de6dd8-1d57-45fc-9263-40c89eeacaa3" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1609.747607] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1610.250077] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.250364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1610.250364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.250535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1610.250629] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1610.250727] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 is going to be created. [ 1610.272849] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.272849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1610.272849] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.273079] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1610.273756] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1610.281421] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 in Status: UNINITIALIZED for 2s [ 1612.291875] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 in Status: SUCCESS [ 1612.292314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1612.292314] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.292484] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1612.292668] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.292786] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1612.292862] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.292985] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1612.293078] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1612.293165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1612.293254] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1612.795329] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1613.297278] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 927ed028-7cbb-4c68-b73f-ab8b09c596a2: rpc.has_security_group_logging(os_id): False [ 1613.315619] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.315785] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1613.315860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.316098] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1613.316192] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1613.316435] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.316536] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1613.316600] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.316749] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1613.316825] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1613.316912] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 is going to be created. [ 1613.373964] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.374128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1613.374196] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.374390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1613.374567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1613.384843] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 in Status: IN_PROGRESS for 2s [ 1613.736620] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1613.736620] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1613.948312] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1613.948472] env[62620]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee8ff2a8-626f-4b20-a59f-3a44857df0e9 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1615.397097] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 in Status: SUCCESS [ 1615.397493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1618.737805] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1618.738324] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1619.321844] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock network-622 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.322118] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1619.322261] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.322529] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1619.322797] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.322994] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1619.323151] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.323369] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1619.323523] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1619.323738] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1619.323860] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] NeedRegenerationException {{(pid=62620) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1619.323977] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] no value, waiting for create lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1619.324104] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] value creation lock acquired {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1619.324223] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] No value present for key: 'zone-id' {{(pid=62620) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1619.324337] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Calling creation function for not-yet-present value {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1619.324476] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1619.343816] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1619.343970] env[62620]: DEBUG dogpile.cache.region [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62620) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1619.344143] env[62620]: DEBUG dogpile.lock [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Released creation lock {{(pid=62620) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1619.344312] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "network-622" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1619.344585] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 taken with stack trace [, , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.344749] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1619.344877] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.345117] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1619.345259] env[62620]: DEBUG networking_nsxv3.api.rpc [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('374cdd5a-3b25-49a6-a1a0-45d9d5a331c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1619.847899] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.848328] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1619.848328] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.848716] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1619.848927] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1619.849283] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.849489] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1619.849657] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.849949] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1619.850158] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1619.850505] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.850702] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1619.850854] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.851144] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1619.851319] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1619.851510] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Resource: SegmentPort with ID: 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 is going to be updated. [ 1619.872711] env[62620]: DEBUG networking_nsxv3.common.locking [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.872918] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1619.873094] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.873375] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1619.873607] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1619.873860] env[62620]: DEBUG oslo_concurrency.lockutils [None req-1d64bdd5-3cfc-423b-9fe3-54e12169389b None None] Releasing lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1620.544829] env[62620]: INFO networking_nsxv3.common.synchronization [req-c44ff66c-3e41-49f1-b60e-b3e09343644b req-e4c22b1d-6dc6-40d4-9670-7067fc2599ca service nova] Enqueued Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_rules [ 1620.545037] env[62620]: INFO networking_nsxv3.common.synchronization [req-c44ff66c-3e41-49f1-b60e-b3e09343644b req-e4c22b1d-6dc6-40d4-9670-7067fc2599ca service nova] Enqueued Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_members [ 1620.545197] env[62620]: INFO networking_nsxv3.common.synchronization [req-c44ff66c-3e41-49f1-b60e-b3e09343644b req-e4c22b1d-6dc6-40d4-9670-7067fc2599ca service nova] Enqueued Resource ID: 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 with Priority: HIGHEST for action port [ 1620.546677] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_rules [ 1620.546677] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_members [ 1620.546677] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 with Priority: HIGHEST for action port [ 1620.546677] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.547107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1620.547107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.547107] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1620.547107] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1620.547891] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.548019] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1620.548090] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.548246] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1620.548387] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.548737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1620.548737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.548737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1620.548737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1620.548931] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1620.549509] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.549616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1620.549683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.549832] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1620.549930] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('374cdd5a-3b25-49a6-a1a0-45d9d5a331c1',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1621.051553] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.051978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1621.051978] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 with status ACTIVE [ 1621.052093] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.052198] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1621.052265] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.052476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1621.052567] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1621.052733] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.052838] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1621.052930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.053110] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1621.053193] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1621.053375] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.053473] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1621.053535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.053675] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1621.053752] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1621.053837] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 374cdd5a-3b25-49a6-a1a0-45d9d5a331c1 is going to be updated. [ 1621.054942] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1621.074462] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.074649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1621.074649] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.074817] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1621.074953] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1621.075116] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-374cdd5a-3b25-49a6-a1a0-45d9d5a331c1" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1621.557136] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1622.060091] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.060552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1622.060552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.060552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1622.060679] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1622.060679] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c083e00-2fed-483b-b205-18ca2016784f is going to be updated. [ 1622.092483] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.092693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1622.092693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.092870] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1622.093071] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1622.100905] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: IN_PROGRESS for 2s [ 1624.111594] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: SUCCESS [ 1624.111988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1624.111988] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.112218] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1624.112407] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.112524] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1624.112585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.112733] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1624.112815] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1624.112905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1624.112994] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.614972] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1625.117234] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c083e00-2fed-483b-b205-18ca2016784f: rpc.has_security_group_logging(os_id): False [ 1625.134147] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.134310] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1625.134381] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.134585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1625.134664] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1625.134903] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.135024] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1625.135086] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.135215] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1625.135286] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1625.135391] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c083e00-2fed-483b-b205-18ca2016784f is going to be updated. [ 1625.197769] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.198021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1625.198021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.198219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1625.198402] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1625.210623] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: IN_PROGRESS for 2s [ 1625.547207] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1625.547407] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1627.224835] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: SUCCESS [ 1627.225284] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1630.548117] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1630.548517] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1635.548892] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1635.549319] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1640.550252] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1640.550615] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1643.896207] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1643.896643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1643.896643] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1643.896735] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1643.896878] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1644.399550] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1644.902216] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1645.404287] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1645.404514] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1645.550825] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1645.550994] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1646.119423] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.119790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1646.119790] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.119876] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1646.131183] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1646.132014] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1646.133043] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1646.172289] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.172437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1646.172437] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.172630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1646.186716] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1646.187419] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1646.187501] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1646.187593] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1646.216512] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.216632] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1646.216693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.216873] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1646.217552] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1646.217684] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1646.295395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.295580] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1646.295663] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.295856] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1646.296169] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1646.296444] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1646.372348] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.372506] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1646.372555] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.372711] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1646.372976] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1646.373269] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1646.373366] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc', '927ed028-7cbb-4c68-b73f-ab8b09c596a2', '4d99f03d-15a0-459e-b7ae-a72419a0b82a', '522dbe7d-0c4e-456f-9be7-2144d27ebc47', '255ec5a6-942e-49be-b759-c091160337f6', '0c083e00-2fed-483b-b205-18ca2016784f', '7027a4f2-13d4-467a-96da-8c378fa8ac69', 'd202a637-704d-4648-b15e-1c9cbe21b05b', '555614d8-7992-4190-9420-95843d76b986', '0a74e416-c2f5-41f6-a7d3-a2cd9c682858', '17653238-10f5-4057-bb3a-0d1116cfe7f0', '7c469d6d-346a-40a2-adb5-8c50f7758224', 'b140e556-13f7-4e22-a7d6-53ddc3943100', 'e84080db-2e0a-4513-addc-aca7401b2740', 'cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d', 'b27f6472-ff8f-4e87-ba84-3f06d7d9c925', 'd79c3337-b12e-40d4-993c-c4d5954de7b0', '84776719-6313-41bf-88fe-129baf34c6ed', 'b84c6a20-87b1-462b-accd-d32f1296df07', '16d45250-e90b-4ed6-befa-bdaacfced30b', '9f23bc15-3356-4a60-a94f-750f1fd18026', 'b2bbf04f-3b75-4f98-a58c-b7dfe66747dd', 'b6e3d709-39db-4789-9664-b707d1759c5b', 'ea919c93-c5eb-459f-869f-c9c9eae06e59', 'c72dcb51-694a-46ed-b921-12a44f522163', '1536c72e-7b4e-46f0-a419-8f3b5002e371'} {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1646.373462] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1646.389907] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.390046] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1646.390091] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.390256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1646.390333] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1646.390429] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1646.390499] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1646.390569] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1646.466758] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.466906] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1646.466958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.467124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1646.468282] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1646.468502] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1646.468583] env[62620]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62620) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1646.468657] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1646.468723] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1646.468799] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1646.468914] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGH for action security_group_rules [ 1646.468957] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGH for action security_group_rules [ 1646.468995] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGH for action security_group_rules [ 1646.469074] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGH for action security_group_rules [ 1646.469137] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGH for action security_group_rules [ 1646.469201] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGH for action security_group_rules [ 1646.469261] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGH for action security_group_rules [ 1646.469324] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGH for action security_group_rules [ 1646.469385] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGH for action security_group_rules [ 1646.469447] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGH for action security_group_rules [ 1646.469509] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGH for action security_group_rules [ 1646.469570] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGH for action security_group_rules [ 1646.469631] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGH for action security_group_rules [ 1646.469694] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGH for action security_group_rules [ 1646.469756] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGH for action security_group_rules [ 1646.469817] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGH for action security_group_rules [ 1646.469916] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGH for action security_group_rules [ 1646.470065] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGH for action security_group_rules [ 1646.470192] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGH for action security_group_rules [ 1646.470265] env[62620]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGH for action security_group_rules [ 1646.470399] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.551717] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1650.552088] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1650.552088] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc with Priority: HIGH for action security_group_rules [ 1650.552244] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a with Priority: HIGH for action security_group_rules [ 1650.552244] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 with Priority: HIGH for action security_group_rules [ 1650.552361] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d with Priority: HIGH for action security_group_rules [ 1650.552465] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d45250-e90b-4ed6-befa-bdaacfced30b with Priority: HIGH for action security_group_rules [ 1650.552561] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84c6a20-87b1-462b-accd-d32f1296df07 with Priority: HIGH for action security_group_rules [ 1650.552656] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84776719-6313-41bf-88fe-129baf34c6ed with Priority: HIGH for action security_group_rules [ 1650.552751] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 with Priority: HIGH for action security_group_rules [ 1650.552841] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84080db-2e0a-4513-addc-aca7401b2740 with Priority: HIGH for action security_group_rules [ 1650.552932] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 with Priority: HIGH for action security_group_rules [ 1650.553031] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140e556-13f7-4e22-a7d6-53ddc3943100 with Priority: HIGH for action security_group_rules [ 1650.553128] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 with Priority: HIGH for action security_group_rules [ 1650.553258] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 with Priority: HIGH for action security_group_rules [ 1650.553359] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 with Priority: HIGH for action security_group_rules [ 1650.553448] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 555614d8-7992-4190-9420-95843d76b986 with Priority: HIGH for action security_group_rules [ 1650.553536] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGH for action security_group_rules [ 1650.553622] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d202a637-704d-4648-b15e-1c9cbe21b05b with Priority: HIGH for action security_group_rules [ 1650.553709] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 255ec5a6-942e-49be-b759-c091160337f6 with Priority: HIGH for action security_group_rules [ 1650.553795] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGH for action security_group_rules [ 1650.553883] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 with Priority: HIGH for action security_group_rules [ 1650.554259] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.554394] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.554461] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.554697] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.554780] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.555732] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.555852] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.555919] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.556097] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.556165] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d99f03d-15a0-459e-b7ae-a72419a0b82a',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.558624] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7027a4f2-13d4-467a-96da-8c378fa8ac69 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.558765] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.558814] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.558939] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.559014] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7027a4f2-13d4-467a-96da-8c378fa8ac69',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.559712] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.559855] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.559896] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.560029] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.560105] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.560775] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d45250-e90b-4ed6-befa-bdaacfced30b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.560878] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.560940] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.561159] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.561159] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d45250-e90b-4ed6-befa-bdaacfced30b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.561825] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b84c6a20-87b1-462b-accd-d32f1296df07 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.561933] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.561995] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.562160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.562251] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b84c6a20-87b1-462b-accd-d32f1296df07',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.563058] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84776719-6313-41bf-88fe-129baf34c6ed taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.563128] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.563195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.563342] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.563417] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84776719-6313-41bf-88fe-129baf34c6ed',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.564090] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d79c3337-b12e-40d4-993c-c4d5954de7b0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.564195] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.564251] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.564418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.564527] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d79c3337-b12e-40d4-993c-c4d5954de7b0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.565163] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84080db-2e0a-4513-addc-aca7401b2740 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.565315] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.565393] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.565556] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.565630] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84080db-2e0a-4513-addc-aca7401b2740',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.566296] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.566429] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.566466] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.566605] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.566676] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b27f6472-ff8f-4e87-ba84-3f06d7d9c925',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.567428] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b140e556-13f7-4e22-a7d6-53ddc3943100 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.567535] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.567598] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.567761] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.567831] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b140e556-13f7-4e22-a7d6-53ddc3943100',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.568530] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c469d6d-346a-40a2-adb5-8c50f7758224 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.568630] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.568695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.568842] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.568916] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c469d6d-346a-40a2-adb5-8c50f7758224',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.569607] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17653238-10f5-4057-bb3a-0d1116cfe7f0 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.569700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.569755] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.569897] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.569998] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17653238-10f5-4057-bb3a-0d1116cfe7f0',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.570635] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.570738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.570803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.570954] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.571039] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a74e416-c2f5-41f6-a7d3-a2cd9c682858',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.571781] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-555614d8-7992-4190-9420-95843d76b986 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.571885] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.571948] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.572111] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.572204] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('555614d8-7992-4190-9420-95843d76b986',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.572879] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.572986] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.573082] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.573212] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.573280] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.573943] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d202a637-704d-4648-b15e-1c9cbe21b05b taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.574064] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.574124] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.574266] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.574341] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d202a637-704d-4648-b15e-1c9cbe21b05b',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.575079] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-255ec5a6-942e-49be-b759-c091160337f6 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.575190] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.575259] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.575407] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.575522] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('255ec5a6-942e-49be-b759-c091160337f6',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.576203] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.576308] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.576365] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.576513] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.576584] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.577243] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.577352] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.577418] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.577572] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.577640] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('522dbe7d-0c4e-456f-9be7-2144d27ebc47',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.605788] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.606036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.606036] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.606155] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.607616] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.607730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.608899] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.609051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.614110] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.614235] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.624512] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.624622] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d45250-e90b-4ed6-befa-bdaacfced30b is going to be deleted. [ 1650.625374] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.625558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.644167] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.644273] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d99f03d-15a0-459e-b7ae-a72419a0b82a is going to be deleted. [ 1650.644958] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.645144] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.663441] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.663549] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84080db-2e0a-4513-addc-aca7401b2740 is going to be deleted. [ 1650.664207] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.664380] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.681095] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.681204] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.682920] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.683081] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7027a4f2-13d4-467a-96da-8c378fa8ac69 is going to be deleted. [ 1650.683821] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.684053] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.684199] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.684378] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d45250-e90b-4ed6-befa-bdaacfced30b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.688537] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.688700] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.688816] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.689021] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.689160] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.689331] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d99f03d-15a0-459e-b7ae-a72419a0b82a" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.706075] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.706202] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.706255] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.706420] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.706507] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.706618] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84080db-2e0a-4513-addc-aca7401b2740" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.728560] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.728686] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1650.728737] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.728893] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1650.728973] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1650.729095] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7027a4f2-13d4-467a-96da-8c378fa8ac69" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.082141] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-927ed028-7cbb-4c68-b73f-ab8b09c596a2 taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.082390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.082390] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.082574] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.082738] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.082837] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.082899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.083051] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.083138] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.083220] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.083324] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.087903] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.088045] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.088125] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.088240] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.088392] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.088492] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.088558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.088705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.088788] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.088879] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.088967] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.131928] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.132166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.132166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.132354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.133791] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.133883] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.134522] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.134616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.135318] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.135424] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.136111] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.136210] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.136833] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.136924] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.137882] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.137982] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.138641] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.138739] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.139368] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.139464] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.140142] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.140249] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.140894] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.140990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.141568] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1651.141943] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.142052] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.142701] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1651.143059] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.143165] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.143761] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1651.144069] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.144166] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.152679] env[62620]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1651.153047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.153157] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b84c6a20-87b1-462b-accd-d32f1296df07 is going to be deleted. [ 1651.153899] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.154092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.169695] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.169802] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a74e416-c2f5-41f6-a7d3-a2cd9c682858 is going to be deleted. [ 1651.170493] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.170670] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.184780] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.184906] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b140e556-13f7-4e22-a7d6-53ddc3943100 is going to be deleted. [ 1651.185608] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.185776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.201080] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.201188] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d is going to be deleted. [ 1651.201858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.202035] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.203248] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.203339] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.220480] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.220592] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d79c3337-b12e-40d4-993c-c4d5954de7b0 is going to be deleted. [ 1651.221273] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.221440] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.234754] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.234850] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.235491] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.235606] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.240978] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.241095] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17653238-10f5-4057-bb3a-0d1116cfe7f0 is going to be deleted. [ 1651.241771] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.241937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.252827] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.252930] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.259432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.259529] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 255ec5a6-942e-49be-b759-c091160337f6 is going to be deleted. [ 1651.260222] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.260388] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.287515] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.287630] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 555614d8-7992-4190-9420-95843d76b986 is going to be deleted. [ 1651.288341] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.288516] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.289739] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.289840] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.329693] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.329854] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc is going to be deleted. [ 1651.330684] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.330886] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.332317] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.332425] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.377009] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.377165] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 522dbe7d-0c4e-456f-9be7-2144d27ebc47 is going to be deleted. [ 1651.377969] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.378189] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.404026] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.404184] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c469d6d-346a-40a2-adb5-8c50f7758224 is going to be deleted. [ 1651.404922] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.405209] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.437852] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.438034] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.473354] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.473466] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84776719-6313-41bf-88fe-129baf34c6ed is going to be deleted. [ 1651.474256] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.474454] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.491333] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.491432] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.495821] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.495923] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.499331] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.499434] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.505918] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.506045] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b27f6472-ff8f-4e87-ba84-3f06d7d9c925 is going to be deleted. [ 1651.506803] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.506999] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.547510] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.547809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.562439] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.562749] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d202a637-704d-4648-b15e-1c9cbe21b05b is going to be deleted. [ 1651.563426] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.563637] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.563726] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.563846] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b84c6a20-87b1-462b-accd-d32f1296df07" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.564013] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.564238] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.564309] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.564367] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a74e416-c2f5-41f6-a7d3-a2cd9c682858" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.564847] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.565011] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.565092] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.565214] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b140e556-13f7-4e22-a7d6-53ddc3943100" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.565346] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.565491] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.565570] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.565678] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf88c8c5-9e8a-4fa5-83e3-b69f7b65334d" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.565802] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.565937] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.566025] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.566137] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d79c3337-b12e-40d4-993c-c4d5954de7b0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.566262] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.566400] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.566475] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.566586] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17653238-10f5-4057-bb3a-0d1116cfe7f0" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.566705] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.566841] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.566913] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.567033] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-255ec5a6-942e-49be-b759-c091160337f6" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.567157] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.567297] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.567373] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.567479] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-555614d8-7992-4190-9420-95843d76b986" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.567604] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.567738] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.567860] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.567905] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9f3dca-0791-4e7e-88c2-5bd4ecf79dcc" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.568041] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.568182] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.568257] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.568363] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c469d6d-346a-40a2-adb5-8c50f7758224" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.568482] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.568620] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.568690] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.568791] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-522dbe7d-0c4e-456f-9be7-2144d27ebc47" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.590199] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.598707] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.642111] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.642301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.642359] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.642558] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.642647] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.642760] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84776719-6313-41bf-88fe-129baf34c6ed" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.646569] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.646683] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.646751] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.646908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.646990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.647134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b27f6472-ff8f-4e87-ba84-3f06d7d9c925" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.711222] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.711392] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1651.711435] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.711609] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1651.711696] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1651.711813] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d202a637-704d-4648-b15e-1c9cbe21b05b" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1652.092649] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 927ed028-7cbb-4c68-b73f-ab8b09c596a2: rpc.has_security_group_logging(os_id): False [ 1652.100323] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c083e00-2fed-483b-b205-18ca2016784f: rpc.has_security_group_logging(os_id): False [ 1652.115422] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.115585] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1652.115633] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.115828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1652.117261] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.117364] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1652.131702] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1652.131948] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.132047] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1652.132142] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.132301] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1652.132383] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1652.132467] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c083e00-2fed-483b-b205-18ca2016784f is going to be updated. [ 1652.133335] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.133539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1652.152428] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1652.152669] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.152776] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1652.152844] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.152996] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1652.153093] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1652.153196] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 is going to be updated. [ 1652.203900] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.204075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1652.204075] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.204260] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1652.204382] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1652.212395] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.212505] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1652.212565] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.212722] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1652.212843] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1652.217905] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: IN_PROGRESS for 2s [ 1652.224359] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 in Status: IN_PROGRESS for 2s [ 1654.235296] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: SUCCESS [ 1654.235730] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1654.236883] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 in Status: SUCCESS [ 1654.237074] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1655.555425] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1655.555632] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1660.556400] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1660.556684] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1665.557700] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1665.558068] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1670.558431] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1670.558776] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1673.918586] env[62620]: INFO networking_nsxv3.common.synchronization [req-f05aea15-6dcd-412f-8cd8-9c65148f6103 req-280c1e5c-cead-4288-b919-31a1efba92af tempest-AttachVolumeShelveTestJSON-1329357808 tempest-AttachVolumeShelveTestJSON-1329357808-project-member] Enqueued Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_members [ 1673.919162] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c083e00-2fed-483b-b205-18ca2016784f with Priority: HIGHEST for action security_group_members [ 1673.919478] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c083e00-2fed-483b-b205-18ca2016784f taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.919610] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1673.919682] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.920304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1673.920304] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.920304] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1673.920502] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.920539] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1673.920661] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1673.920714] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c083e00-2fed-483b-b205-18ca2016784f',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1674.422561] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.422758] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1674.422809] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.423030] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1674.423133] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1674.423347] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.423459] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1674.423551] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.423744] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1674.423828] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1674.423954] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c083e00-2fed-483b-b205-18ca2016784f is going to be updated. [ 1674.450667] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.450810] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1674.450858] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.450990] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1674.451134] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1674.458359] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: IN_PROGRESS for 2s [ 1676.468822] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c083e00-2fed-483b-b205-18ca2016784f in Status: SUCCESS [ 1676.469201] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c083e00-2fed-483b-b205-18ca2016784f deletion is rescheduled due to dependency. [ 1676.469201] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c083e00-2fed-483b-b205-18ca2016784f" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1678.919923] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1678.919923] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1683.920723] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1683.921035] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1684.261510] env[62620]: INFO networking_nsxv3.common.synchronization [req-2c48bb38-d9f6-4e55-bf7e-d444200b064a req-4e9d3974-de17-4123-9366-1f3582e4f36a tempest-AttachVolumeTestJSON-1790956899 tempest-AttachVolumeTestJSON-1790956899-project-member] Enqueued Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_members [ 1684.262087] env[62620]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 with Priority: HIGHEST for action security_group_members [ 1684.262427] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock member-927ed028-7cbb-4c68-b73f-ab8b09c596a2 taken with stack trace [, , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.262550] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1684.262616] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.262908] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1684.263271] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.263271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1684.263271] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.263453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1684.263453] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1684.263538] env[62620]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927ed028-7cbb-4c68-b73f-ab8b09c596a2',) {} {{(pid=62620) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1684.767050] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.767050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1684.767050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.767050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1684.767050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1684.767050] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.767050] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1684.767490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.767490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1684.767490] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1684.767490] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 is going to be updated. [ 1684.796689] env[62620]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62620) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.796880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1684.796880] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.797076] env[62620]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1684.797219] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1684.804565] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 in Status: IN_PROGRESS for 2s [ 1686.815078] env[62620]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 in Status: SUCCESS [ 1686.815476] env[62620]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927ed028-7cbb-4c68-b73f-ab8b09c596a2 deletion is rescheduled due to dependency. [ 1686.815476] env[62620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927ed028-7cbb-4c68-b73f-ab8b09c596a2" {{(pid=62620) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1689.263400] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1689.263884] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1694.264644] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1694.265066] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1699.266500] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1699.266982] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1704.267633] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1704.268138] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1709.268942] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1709.269399] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1714.269646] env[62620]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1714.270047] env[62620]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0